-- Logs begin at Thu 2021-04-08 11:21:02 UTC, end at Thu 2021-04-08 12:35:28 UTC. -- Apr 08 12:04:59.571388 dv-cinder-784779-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 12:04:59.579150 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Apr 8 12:04:59 2021] *** Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: nodename: dv-cinder-784779-3-iscsi Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: machine: x86_64 Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: clock source: unix Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: pcre jit disabled Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: detected number of CPU cores: 4 Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: current working directory: / Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: detected binary path: /usr/bin/uwsgi-core Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: dropping root privileges as early as possible Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: your processes number limit is 47843 Apr 08 12:04:59.581246 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: your memory page size is 4096 bytes Apr 08 12:04:59.582432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: detected max file descriptor number: 2048 Apr 08 12:04:59.582432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: lock engine: pthread robust mutexes Apr 08 12:04:59.582432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: thunder lock: enabled Apr 08 12:04:59.582432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 12:04:59.582432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: dropping root privileges after socket binding Apr 08 12:04:59.582432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 08 12:04:59.628089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: Python main interpreter initialized at 0x559875b409c0 Apr 08 12:04:59.628089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: dropping root privileges after plugin initialization Apr 08 12:04:59.628089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: python threads support enabled Apr 08 12:04:59.628089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: your server socket listen backlog is limited to 100 connections Apr 08 12:04:59.628089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: your mercy for graceful operations on workers is 90 seconds Apr 08 12:04:59.628581 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: mapped 402621 bytes (393 KB) for 2 cores Apr 08 12:04:59.628581 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: *** Operational MODE: preforking *** Apr 08 12:04:59.628763 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: dropping root privileges after application loading Apr 08 12:04:59.628763 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: *** uWSGI is running in multiple interpreter mode *** Apr 08 12:04:59.628763 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: spawned uWSGI master process (pid: 83743) Apr 08 12:04:59.628912 dv-cinder-784779-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 12:04:59.629138 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: spawned uWSGI worker 1 (pid: 83744, cores: 1) Apr 08 12:04:59.629651 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: spawned uWSGI worker 2 (pid: 83745, cores: 1) Apr 08 12:04:59.629651 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 12:05:04.394985 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 08 12:05:04.395493 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 08 12:05:04.396858 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 08 12:05:04.397298 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 08 12:05:04.397599 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 08 12:05:04.398064 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.398462 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.398836 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.399200 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.400354 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.400774 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.401205 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.401578 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.401960 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.402264 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.402655 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.403033 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784779-3-iscsi {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.403407 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.403763 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.404118 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.404493 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.404842 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.405101 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 08 12:05:04.405201 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.405408 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 08 12:05:04.405506 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.406142 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.406522 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.406872 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.407025 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 08 12:05:04.407227 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.407378 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 08 12:05:04.407618 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.407788 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 08 12:05:04.407979 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.408124 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.408333 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.408486 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.408706 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.408862 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.409060 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.409211 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.409424 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.409575 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.409768 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.409923 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.410106 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.410252 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784779-3-iscsi {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.410473 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.410641 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.410825 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.410981 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.411126 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.411272 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.411410 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.411630 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.411786 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784779-3-iscsi {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.411988 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.412143 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.412343 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.412489 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.412716 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.412862 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.413067 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.413214 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.413412 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.413566 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.413766 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.413918 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.414110 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.414256 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.414519 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.415491 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.415699 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.415852 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.416013 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.416209 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.416351 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.416583 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.416734 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.416878 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.417021 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.417175 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.417320 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.417538 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.417698 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.417848 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.417986 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.418129 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.418269 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.418867 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.418966 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419069 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419163 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419256 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784779-3-iscsi {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419356 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419453 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419551 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419655 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419766 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419870 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.419965 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.420331 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.420431 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.420669 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.420773 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.421017 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.421135 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.421365 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.421469 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.421714 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.421813 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.422050 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.422155 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.422415 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.422519 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.422764 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.422863 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.423115 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.423214 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.423472 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.423582 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.423800 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.423904 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.424144 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.424247 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.424489 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.424595 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.424838 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.424950 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.425180 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.425295 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.425516 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.425623 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.425802 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.425900 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.426147 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.426245 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.426534 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.426643 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.426896 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.426994 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.427250 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.427349 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.427539 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.427690 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.427796 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.427940 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.428139 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.428289 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.428509 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.428608 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.428853 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.428956 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.429197 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.429307 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.429540 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.429639 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.429881 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.429981 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.430215 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.430379 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.430652 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.430806 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.431106 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.431226 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.431387 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.431487 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.431737 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.431840 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.432087 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.432186 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.432432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.432532 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.432782 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.432881 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.433131 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.433230 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.433479 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.433583 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.433822 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.433920 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.434160 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.434257 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.434534 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.434641 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.434882 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.434991 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.435221 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.435348 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.435560 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.435671 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.435909 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.436014 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.436255 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.436361 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.436596 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.436694 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.436926 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.437024 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.437264 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.437375 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.437622 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.437711 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.437945 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.438049 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.438228 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.438422 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.438610 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.438715 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.438951 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.439049 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.439310 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.439416 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.439649 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.439748 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.439979 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.440077 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.440322 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.440427 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.440658 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.440756 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.440989 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.441094 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.441332 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.441443 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.441667 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.441765 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.441998 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.442097 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.442359 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.442463 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.442700 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.442799 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.443030 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.443133 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.443365 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.443470 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.443692 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.443790 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.444028 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.444131 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.444377 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.444478 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.444707 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.444810 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.445038 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.445142 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.445371 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.445487 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.445707 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.445807 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.446060 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.446168 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.446457 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.446659 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.446869 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.446972 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.447140 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.447305 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.447519 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.447617 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.447903 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.448006 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.448280 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.448386 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.448622 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.448726 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.448963 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.449060 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.449319 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.449418 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.449653 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.449751 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.449992 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.450090 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.450360 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.450481 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.450720 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.450814 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.451059 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.451153 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.451398 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.451498 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.451736 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.451830 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.452074 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.452172 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.452413 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.452505 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.452752 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.452850 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.453089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.453192 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.453422 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.453514 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.453774 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.453867 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.454126 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.454229 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.454492 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.454584 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.454832 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.454924 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.455170 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.455272 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.455530 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.455622 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:05:04.455888 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.455980 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.456268 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.456371 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.456617 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.456709 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.456970 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.457068 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.457318 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.457410 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.457691 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.457810 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.458043 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.458165 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.458407 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.458510 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.458758 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.458866 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.459115 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.459215 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.459463 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.459561 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.459802 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.459907 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.460150 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.460250 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.460507 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.460611 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.460855 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.460954 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.461197 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.461302 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.461550 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.461661 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.462456 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.462682 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.462772 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.462846 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.463112 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.463218 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.463480 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.463589 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.463839 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.463944 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.464184 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.464292 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.464526 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.464625 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.464897 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.464994 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.465254 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.465359 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.465603 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.465714 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.465943 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.466043 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.466295 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.466440 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.466672 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.466776 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.467018 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.467126 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.467372 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.467473 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.467718 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.467816 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.468063 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.468160 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.468414 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.468524 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.468754 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.468859 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.469107 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.469211 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.469453 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.469552 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.469799 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.469897 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.470133 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.470236 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.470515 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.470621 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.470859 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.470964 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.471208 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.471313 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.471564 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.471651 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.471913 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.472017 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.472278 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.472383 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.472612 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.472709 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.472978 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.473076 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.473320 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.473424 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.473669 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.473766 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.474009 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.474111 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.474379 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.474559 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.474692 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.474824 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.475052 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.475232 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.475356 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.475487 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.475727 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.475868 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.476064 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.476205 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.476401 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.476550 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.476762 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.476906 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.477100 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.477258 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.478052 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.478275 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.478453 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.478682 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.478920 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.479029 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.479273 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.479373 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.479624 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.479728 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.479994 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.480108 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.480350 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.480450 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.480700 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.480798 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.481079 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.481185 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.481438 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.481542 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.481772 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.481869 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.482140 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.482250 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.482514 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.482613 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.482862 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.482960 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.483201 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.483312 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.483541 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.483640 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.483884 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.483988 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.484227 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.484333 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.484562 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.484660 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.484907 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.485019 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.485242 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.485363 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.485599 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.485719 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.485981 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.486080 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.486355 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.486474 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.486716 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.486827 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.487090 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.487203 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.487428 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.487529 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.487775 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.487873 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.488109 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.488207 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.488452 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.488553 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.488801 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.488904 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.489146 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.489251 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.489496 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.489595 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.489848 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.489952 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.490192 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.490289 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.490844 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.490956 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.491192 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.491291 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.491540 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.491645 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.491876 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.491974 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.492217 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.492315 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.492574 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.492683 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.492918 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.493074 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.493419 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.493507 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.493771 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.494121 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.494221 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.494510 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.494863 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.494962 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.495209 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.495517 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.495617 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.495892 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.495976 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.496234 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.496334 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.496585 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.496689 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.496936 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.497051 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.497284 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.497390 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.497616 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.497714 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.497967 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.498072 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.498334 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.498452 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.498688 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.498786 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.499028 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.499127 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.499372 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.499477 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.499726 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.499825 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.500067 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.500173 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.500410 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.500515 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.500755 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.500859 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.501104 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.501188 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.501457 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.501558 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.501795 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.501893 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.502147 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.502249 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.502534 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.502635 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.502872 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.502975 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.503215 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.503313 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.503579 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.503678 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.503919 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.504016 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.504263 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.504361 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.504607 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.504712 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.504948 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.505045 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.505308 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.505702 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.505956 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.506055 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.506338 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.506674 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.506772 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.507038 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.507143 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.507388 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.507487 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.507741 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.507839 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.508090 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.508194 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.508439 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.508543 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.508844 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.508988 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.509219 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.509301 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.509580 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.509679 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.509924 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.510036 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.510273 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.510429 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.510643 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.510754 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.510986 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.511096 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.511345 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.511443 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.511689 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.511786 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.512031 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.512136 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.512376 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.512474 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.512711 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.512808 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.513056 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.513161 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.513400 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.513498 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.513743 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.514093 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.514190 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.514469 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.514572 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.514821 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.514932 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.515175 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.515283 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.515514 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.515620 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.515873 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.515971 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.516220 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.516325 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.516572 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.516669 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.516916 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.517020 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.517255 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.517360 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.517595 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.517693 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.517943 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.518047 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.518288 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.518482 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.518660 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.518765 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.519007 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.519106 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.519351 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.519501 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.519695 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.519795 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.520043 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.520141 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.520385 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.520484 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.520720 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.520817 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.521064 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.521162 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.521409 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.521513 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.521754 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.521852 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.522096 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.522186 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.522479 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.522581 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.522817 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.522914 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.523157 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.523263 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.523502 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.523601 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.523842 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.523940 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.524173 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.524786 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.525031 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.525149 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.525507 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.525606 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.525851 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.525957 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.526202 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.526314 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.526587 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.526691 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.526943 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.527057 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.527294 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.527378 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.527641 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.527740 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.527984 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.528089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.528324 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.528429 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.528667 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.528770 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.529006 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.529112 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.529352 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.529451 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.529686 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.529785 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.530035 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.530134 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.530410 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.530514 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.530771 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.530868 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.531104 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.531203 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.531440 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.531524 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.531783 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.531888 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.532132 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.532236 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.532473 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.532572 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.532805 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.532902 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.533144 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.533243 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.533481 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.533578 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.533819 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.533916 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.534152 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.534254 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.534542 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.534651 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.534884 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.535045 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.535219 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.535317 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.535558 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.535656 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.535891 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.535996 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.536239 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.536342 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.536587 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.536685 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.536951 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.537056 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.537309 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.537412 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.537654 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.537753 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.538002 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.538107 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.538366 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.538467 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.538713 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.538812 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.539056 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.539161 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.539406 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.539503 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.539741 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.539877 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.540647 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.540735 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.540994 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.541092 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.541328 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.541432 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.541673 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.541771 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.542031 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.542129 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.542391 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.542502 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.542737 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.542836 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.543082 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.543180 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.543427 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.543526 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.543786 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.543884 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.544124 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.544223 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.544472 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.544569 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.544829 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.544928 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.545180 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.545278 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.545528 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.545633 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.545872 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.545971 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.546219 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.546341 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.546589 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.546699 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.546934 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.547037 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.547277 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.547376 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.547624 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.547729 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.547959 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.548058 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.548322 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.548419 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.548668 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.548772 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.549013 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.549112 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.549360 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.549458 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.549713 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.549811 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.550072 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.550188 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.550437 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.550540 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.550783 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.550935 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.551132 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.551298 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.551477 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.551658 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.551814 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.552009 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.552144 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.552366 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.552486 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.552723 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.552829 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.553084 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.553187 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.553443 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.553546 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.553783 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.553887 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.554119 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.554262 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.554496 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.554647 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.554847 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.555005 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.555190 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.555361 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.555579 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.555769 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.555932 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.556120 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.556276 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.556476 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.556622 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.556854 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.556959 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.557207 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.557307 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.557557 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.557660 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.557908 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.558050 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.558281 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.558414 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.558653 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.558756 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.559026 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.559125 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.559379 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.559503 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.559730 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.559828 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.560086 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.560186 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.560439 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.560606 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.560784 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.560963 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.561258 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.561357 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.561606 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.561704 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.561955 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.562053 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.562342 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.562444 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.562666 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.562764 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.563009 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.563116 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.563354 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.563451 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.563709 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.563808 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.564052 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.564158 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.564392 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.564491 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.564731 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.564829 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.565073 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.565182 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.565408 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.565513 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.565767 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.565865 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.566123 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.566229 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.566523 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.566623 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.566897 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.566994 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.567347 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.567455 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.567690 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.567789 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.568040 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.568138 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.568406 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.568510 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.568757 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.568856 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.569109 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.569212 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.569441 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.569541 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.569785 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.569888 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.570123 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.570222 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.570513 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.570628 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.570854 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.570951 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.571734 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.571847 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.572090 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.572436 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.572540 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.572803 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.573136 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.573245 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.573491 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.573802 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.573910 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.574374 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.574479 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.574690 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.574858 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.575040 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.575224 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.575406 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.575609 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.575775 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.575991 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.576089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.576374 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.576472 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.576756 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.576864 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.577089 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.577193 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.577433 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.577532 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.577794 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.577899 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.578128 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.578227 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.578500 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.578610 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.578843 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.578942 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.579193 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.579291 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.579534 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.579638 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.579877 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.579981 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.580240 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.580342 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.580582 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.580681 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.580944 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.581043 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.581286 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.581384 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.581650 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.581748 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.582016 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.582115 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.582374 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.582499 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.582742 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.582860 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.583086 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.583188 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.583433 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.583532 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.583774 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.583879 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.584117 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.584222 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.584473 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.584571 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.584807 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.584915 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.585157 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.585267 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.585510 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.585607 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.585862 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.585968 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.586202 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.586354 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.586608 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.586801 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.587464 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.587546 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.587825 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.587926 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.588172 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.588278 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.588527 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.588632 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.588860 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.588965 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.589204 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.589303 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.589550 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.589660 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.589893 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.589993 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.590237 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.590365 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.590607 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.590775 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.590953 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.591054 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.591298 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.591397 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.591639 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.591748 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.591980 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.592085 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.592347 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.592508 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.592693 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.592803 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.593047 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.593192 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.593389 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.593490 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.593734 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.593840 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.594078 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.594178 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.594449 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.594554 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.594794 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.594896 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.595152 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.595251 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.595503 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.595603 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.595856 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.595957 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.596221 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.596446 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.596594 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.596825 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.596926 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.597186 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.597286 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.597548 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.597653 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.597909 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.598009 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.598254 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.598382 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.598632 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.598747 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.598978 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.599079 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.599324 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.599423 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.599667 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.599776 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.600016 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.600116 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.600359 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.600459 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.600712 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.600818 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.601067 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.601166 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.601448 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.601662 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.601817 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.602033 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.602179 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.602433 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.602613 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.602787 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.602982 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.603138 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.603404 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.603509 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.603772 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.603873 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.604127 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.604228 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.604464 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.604564 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.604810 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.604911 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.605156 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.605257 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.605510 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.605610 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.605867 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.605967 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.606215 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.606381 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.606621 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.606730 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.606965 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.607071 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.607309 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.607409 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.607649 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.607756 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.607998 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.608105 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.608381 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.608489 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.608730 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.608829 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.609077 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.609178 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.609435 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.609535 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.609785 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.609884 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.610135 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.610236 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.610517 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.610743 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.610843 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.611110 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.611221 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.611493 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.611598 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.611835 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.611941 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.612184 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.612290 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.612533 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.612638 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.612882 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.612981 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.613255 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.613410 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.613611 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.613721 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.613958 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.614057 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.614323 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.614427 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.614672 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.614771 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.615046 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.615155 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.615382 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.615860 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.616018 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.616213 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.616373 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.616591 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.616742 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.616957 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.617098 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.617323 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.617679 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.617787 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.618062 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.618171 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.618477 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.618563 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.618880 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.618993 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.619227 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.619334 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.619579 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.619679 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.619924 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.620031 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.620260 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.620359 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.620627 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.620728 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.620970 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.621076 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.621309 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.621414 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.621666 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.621767 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.622005 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.622111 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.622382 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.622645 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.622747 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.623044 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.623180 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.623393 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.623493 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.623750 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.623851 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.624094 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.624204 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.624448 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.624547 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.624794 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.624893 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.625147 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.625258 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.625483 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.625582 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.625827 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.625927 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.626168 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.626268 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.626540 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.626644 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.626882 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.626982 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.627216 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.627318 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.627564 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.627664 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.627905 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.628006 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.628248 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.628349 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.628587 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.628732 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.628921 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.629028 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.629269 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.629369 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.629602 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.629701 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.629943 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.630054 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.630278 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.630448 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.630669 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.630789 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.631007 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.631096 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.631339 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.631440 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.631681 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.631780 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.632021 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.632128 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.632372 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.632472 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.632705 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.632805 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.633051 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.633158 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.633395 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.633502 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.634279 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.634558 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.634732 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.635084 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.635185 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.635430 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.635530 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.635798 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.635906 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.636143 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.636243 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.636487 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.636591 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.636846 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.636955 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.637191 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.637290 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.637549 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.637648 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.637898 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.638007 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.638249 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.638368 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.638665 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.638791 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.639011 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.639122 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.639360 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.639613 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.639761 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.639991 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.640092 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.640353 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.640454 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.640741 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.640841 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.641126 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.641237 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.641466 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.641566 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.641813 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.641912 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.642159 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.642269 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.642553 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.642657 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.642904 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.643005 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.643255 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.643392 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.643604 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.643690 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.643955 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.644061 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.644295 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.644401 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.644645 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.644756 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.645036 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.645142 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.645345 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.645457 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.645687 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.645796 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.646028 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.646174 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.646459 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.646566 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.646823 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.646935 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.647181 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.647281 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.647535 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.647635 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.647890 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.647991 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.648242 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.648350 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.648593 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.648692 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.648944 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.649044 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.649879 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.650008 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.650232 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.650359 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.650637 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.650740 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.650992 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.651100 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.651337 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.651436 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.651777 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.651882 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.652139 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.652247 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.652497 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.652597 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.652859 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.652959 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.653212 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.653312 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.653560 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.653659 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.653923 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.654027 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.654284 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.654431 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.654673 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.654775 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.655013 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.655097 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.655360 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.655474 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.655705 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.655812 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.656054 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.656158 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.656421 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.656521 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.656784 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.656893 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.657135 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.657253 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.657479 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.657586 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.657846 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.657946 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.658190 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.658318 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.658566 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.658666 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.658918 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.659063 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.659269 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.659377 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.659620 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.659720 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.659969 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.660068 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.660317 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.660424 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.660668 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.660773 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.661007 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.661138 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.661374 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.661475 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.661742 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.661851 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.662059 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.662158 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.662394 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.662505 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.662743 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.662843 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.663094 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.663194 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.663450 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.663543 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.663799 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.663945 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.664157 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.664258 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.664513 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.664615 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.664871 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.664976 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.665243 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.665350 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.665592 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.665693 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.665957 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.666057 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.666329 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.666458 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.666684 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.666789 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.667038 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.667138 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.667386 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.667493 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.667733 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.667841 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.668084 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.668184 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.668444 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.668551 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.668784 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.668884 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.669133 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.669232 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.669472 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.669573 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.669828 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.669929 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.670186 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.670286 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.670559 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.670661 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.670924 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.671031 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.671271 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.671371 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.671631 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.671731 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.671986 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.672087 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.672336 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.672444 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.672712 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.672811 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.672987 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 08 12:05:04.673087 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.673392 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.673743 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.674094 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.674500 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.674854 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.675223 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.675590 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.675957 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.676325 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.676715 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.677070 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.677460 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.677835 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:05:04.678113 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 08 12:05:04.708514 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:04.713571 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:04.973092 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.context [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6939815c-34f4-422f-95c0-797235378b0a(cell1) {{(pid=83745) load_cells /opt/stack/nova/nova/context.py:466}} Apr 08 12:05:04.973317 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.context [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6939815c-34f4-422f-95c0-797235378b0a(cell1) {{(pid=83744) load_cells /opt/stack/nova/nova/context.py:466}} Apr 08 12:05:04.979123 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:05:04.979243 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:05:04.980962 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:05:04.981091 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:05:04.981817 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:05:04.981928 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:05:04.983978 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:05:04.984093 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:05:05.008713 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:05.015436 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:05.016234 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:05.016376 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:05.043803 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:05.048333 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:05:05.174234 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:05:05.174234 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: from cryptography.utils import int_from_bytes Apr 08 12:05:05.174644 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:05:05.174644 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: from cryptography.utils import int_from_bytes Apr 08 12:05:05.198463 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:05:05.198463 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: from cryptography.utils import int_from_bytes Apr 08 12:05:05.198856 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:05:05.198856 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: from cryptography.utils import int_from_bytes Apr 08 12:05:05.252124 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Loading Gnome Apr 08 12:05:05.272210 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Loading Google Apr 08 12:05:05.276267 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Loading Windows (alt) Apr 08 12:05:05.277592 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Loading Gnome Apr 08 12:05:05.280938 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Loading file Apr 08 12:05:05.282036 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Loading keyczar Apr 08 12:05:05.282517 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Loading multi Apr 08 12:05:05.283407 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Loading pyfs Apr 08 12:05:05.298030 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Loading Google Apr 08 12:05:05.301479 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Loading Windows (alt) Apr 08 12:05:05.307090 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Loading file Apr 08 12:05:05.308198 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Loading keyczar Apr 08 12:05:05.308643 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Loading multi Apr 08 12:05:05.309507 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO keyring.backend [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Loading pyfs Apr 08 12:05:05.567078 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:05:05.574338 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:05:05.594332 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:05:05.601415 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:05:05.905957 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:05:05.911609 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:05:05.917453 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559875b409c0 pid: 83744 (default app) Apr 08 12:05:05.919699 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:05:05.920894 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001803 Apr 08 12:05:05.921333 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 779 bytes} [Thu Apr 8 12:05:05 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:05:05.939720 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:05:05.945381 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WARNING keystonemiddleware.auth_token [None req-217d2eb9-adb5-428b-a911-73f427615527 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:05:05.952000 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559875b409c0 pid: 83745 (default app) Apr 08 12:06:33.798148 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:33.799266 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Apr 08 12:06:33.799745 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:34.295630 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-3eb7ea4a-c35a-451f-ba16-77d14b48d74f admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:34.327678 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-3eb7ea4a-c35a-451f-ba16-77d14b48d74f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.519613 Apr 08 12:06:34.328263 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1281 bytes} [Thu Apr 8 12:06:33 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:06:36.846192 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:36.847285 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-10bae18b-dcc7-49c7-96e0-5ae721c144df None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Apr 08 12:06:36.847718 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:36.908476 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-d2261435-a995-4163-8a71-ed9c6d5c9454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:36.932840 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:06:36.932840 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: warnings.warn(msg) Apr 08 12:06:36.983144 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-d2261435-a995-4163-8a71-ed9c6d5c9454 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.128359 Apr 08 12:06:36.983741 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:37.226980 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-b1632d6b-aca0-4bd5-985d-13745b0f2368 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:37.230392 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:06:37.230392 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: warnings.warn(msg) Apr 08 12:06:37.304533 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-b1632d6b-aca0-4bd5-985d-13745b0f2368 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.311096 Apr 08 12:06:37.305079 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1325 bytes} [Thu Apr 8 12:06:36 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:06:39.777533 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-d2261435-a995-4163-8a71-ed9c6d5c9454 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:39.778649 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-d2261435-a995-4163-8a71-ed9c6d5c9454 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Apr 08 12:06:39.779093 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:39.892697 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-be461219-d6fe-482b-ab57-9be247f8a46b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "swap": 0, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:39.916351 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:06:39.916351 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: warnings.warn(msg) Apr 08 12:06:40.011871 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-be461219-d6fe-482b-ab57-9be247f8a46b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.226325 Apr 08 12:06:40.012421 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:40.025759 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-839a1adc-0df2-4e15-90ea-f0791c7b14df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:40.027412 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:06:40.027412 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: warnings.warn(msg) Apr 08 12:06:40.123114 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-839a1adc-0df2-4e15-90ea-f0791c7b14df admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101980 Apr 08 12:06:40.123748 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1325 bytes} [Thu Apr 8 12:06:40 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:06:42.598189 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-be461219-d6fe-482b-ab57-9be247f8a46b admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:42.599305 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-be461219-d6fe-482b-ab57-9be247f8a46b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Apr 08 12:06:42.599747 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:42.659659 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-0bf36cdb-363f-4db7-bde5-405ee5bf6936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:42.711521 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-0bf36cdb-363f-4db7-bde5-405ee5bf6936 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.105122 Apr 08 12:06:42.712120 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:42.724662 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-3bfd6fca-c7c8-4f89-b34f-d4ea402cf098 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:42.787229 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-3bfd6fca-c7c8-4f89-b34f-d4ea402cf098 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066461 Apr 08 12:06:42.787868 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1325 bytes} [Thu Apr 8 12:06:42 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:06:45.256989 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-0bf36cdb-363f-4db7-bde5-405ee5bf6936 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:45.258716 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-0bf36cdb-363f-4db7-bde5-405ee5bf6936 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Apr 08 12:06:45.259164 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:45.318989 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-1e4912cb-2892-4d3d-b308-a2fa546cd3f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 2048, "name": "ds2G", "vcpus": 2}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:45.414720 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-1e4912cb-2892-4d3d-b308-a2fa546cd3f2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149198 Apr 08 12:06:45.415331 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:45.427908 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-c30194a8-8c88-41e1-bbcb-333bb60e7347 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:45.496655 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-c30194a8-8c88-41e1-bbcb-333bb60e7347 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072596 Apr 08 12:06:45.497206 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1325 bytes} [Thu Apr 8 12:06:45 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:06:48.048519 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-1e4912cb-2892-4d3d-b308-a2fa546cd3f2 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:48.049592 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-1e4912cb-2892-4d3d-b308-a2fa546cd3f2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Apr 08 12:06:48.050029 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:48.111066 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-cc58e0c8-9a1a-4496-9d32-98a20a735398 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:48.177419 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-cc58e0c8-9a1a-4496-9d32-98a20a735398 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.120114 Apr 08 12:06:48.178009 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:48.191187 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-01f85a8f-f62c-4397-af60-6f543c1d78b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:48.255989 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-01f85a8f-f62c-4397-af60-6f543c1d78b3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068671 Apr 08 12:06:48.256605 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1325 bytes} [Thu Apr 8 12:06:48 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:06:50.734185 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-cc58e0c8-9a1a-4496-9d32-98a20a735398 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:50.735356 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-cc58e0c8-9a1a-4496-9d32-98a20a735398 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Apr 08 12:06:50.735797 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:50.796821 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-8159bd20-5f9b-4649-9fdb-e9afc55f460f admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:50.821780 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-8159bd20-5f9b-4649-9fdb-e9afc55f460f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079184 Apr 08 12:06:50.822368 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1281 bytes} [Thu Apr 8 12:06:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:06:53.309155 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-cc58e0c8-9a1a-4496-9d32-98a20a735398 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:53.310243 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-cc58e0c8-9a1a-4496-9d32-98a20a735398 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Apr 08 12:06:53.310727 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:53.371212 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-de433d56-52bf-49b0-95f8-85318154ce8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "rxtx_factor": 1.0}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:53.423762 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-de433d56-52bf-49b0-95f8-85318154ce8c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.106722 Apr 08 12:06:53.424435 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:53 2021] POST /compute/v2.1/flavors => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:53.437760 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-171eb541-ca44-45ef-bd16-d007046ca37f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:53.494684 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-171eb541-ca44-45ef-bd16-d007046ca37f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060730 Apr 08 12:06:53.495232 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1322 bytes} [Thu Apr 8 12:06:53 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:06:55.971519 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-de433d56-52bf-49b0-95f8-85318154ce8c admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:55.972604 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-de433d56-52bf-49b0-95f8-85318154ce8c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Apr 08 12:06:55.973048 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:56.033931 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-a4f134ba-c5f5-4da2-8f4a-803737080148 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:56.094095 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-a4f134ba-c5f5-4da2-8f4a-803737080148 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.114010 Apr 08 12:06:56.094716 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:56.108166 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-501b78eb-e62d-4cce-b053-f98336fce544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:56.170682 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-501b78eb-e62d-4cce-b053-f98336fce544 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066318 Apr 08 12:06:56.171239 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1322 bytes} [Thu Apr 8 12:06:56 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:06:58.691519 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-a4f134ba-c5f5-4da2-8f4a-803737080148 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:06:58.692605 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-a4f134ba-c5f5-4da2-8f4a-803737080148 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Apr 08 12:06:58.693057 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:06:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:06:58.753173 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-460f38da-e001-4e4f-97d0-a03a813a55c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "swap": 0, "id": "3", "rxtx_factor": 1.0}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:58.805843 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-460f38da-e001-4e4f-97d0-a03a813a55c9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.106387 Apr 08 12:06:58.806463 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:06:58 2021] POST /compute/v2.1/flavors => generated 406 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:06:58.819175 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-50e3af7e-63f3-4420-bf6b-e658afef0bfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:06:58.882288 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-50e3af7e-63f3-4420-bf6b-e658afef0bfb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067055 Apr 08 12:06:58.883148 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1322 bytes} [Thu Apr 8 12:06:58 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:07:01.345735 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-460f38da-e001-4e4f-97d0-a03a813a55c9 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:07:01.346890 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-460f38da-e001-4e4f-97d0-a03a813a55c9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Apr 08 12:07:01.347339 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:07:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:07:01.410846 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-93897bce-3749-470a-a294-360a0ce550df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "ram": 8192}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:07:01.465119 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-93897bce-3749-470a-a294-360a0ce550df admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.110689 Apr 08 12:07:01.465712 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:07:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:07:01.478833 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-7ec55a1c-7a40-4a89-9dc1-7e23576fb6bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:07:01.539886 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-7ec55a1c-7a40-4a89-9dc1-7e23576fb6bf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065453 Apr 08 12:07:01.540505 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1322 bytes} [Thu Apr 8 12:07:01 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:07:04.010879 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-93897bce-3749-470a-a294-360a0ce550df admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:07:04.012002 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-93897bce-3749-470a-a294-360a0ce550df admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Apr 08 12:07:04.012494 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:07:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:07:04.074881 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-f56de4c8-98e1-4b6b-a905-f4906072d32f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:07:04.126514 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-f56de4c8-98e1-4b6b-a905-f4906072d32f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.107839 Apr 08 12:07:04.127103 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1272 bytes} [Thu Apr 8 12:07:04 2021] POST /compute/v2.1/flavors => generated 408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:07:04.140435 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-677a9027-0104-4f2b-9653-b5c50a51e364 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:07:04.203217 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-677a9027-0104-4f2b-9653-b5c50a51e364 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066608 Apr 08 12:07:04.203769 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1322 bytes} [Thu Apr 8 12:07:04 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:08:18.209522 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-f56de4c8-98e1-4b6b-a905-f4906072d32f admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:18.210632 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-f56de4c8-98e1-4b6b-a905-f4906072d32f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Apr 08 12:08:18.211073 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 920 bytes} [Thu Apr 8 12:08:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:18.271443 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-330122a1-97e3-47b7-a5b1-258d32028e97 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:18.338028 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-330122a1-97e3-47b7-a5b1-258d32028e97 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.119911 Apr 08 12:08:18.338649 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1281 bytes} [Thu Apr 8 12:08:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:08:20.025756 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-f56de4c8-98e1-4b6b-a905-f4906072d32f admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:20.027929 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-f56de4c8-98e1-4b6b-a905-f4906072d32f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Apr 08 12:08:20.028370 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:20 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:20.212673 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-de59cd21-1387-4c00-b8f5-87e37cc73045 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:20.229505 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.wsgi [None req-de59cd21-1387-4c00-b8f5-87e37cc73045 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 12:08:20.230445 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-de59cd21-1387-4c00-b8f5-87e37cc73045 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:08:20.231302 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-de59cd21-1387-4c00-b8f5-87e37cc73045 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.072608 Apr 08 12:08:20.231857 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1181 bytes} [Thu Apr 8 12:08:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 12:08:20.241796 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-f4e5ed00-fea2-4ab5-943b-78935954bf12 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:20.263933 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-f4e5ed00-fea2-4ab5-943b-78935954bf12 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025942 Apr 08 12:08:20.264507 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1201 bytes} [Thu Apr 8 12:08:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:08:20.274600 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-f855916f-6034-4a0c-ac3b-9ae8377eecbb admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:20.296944 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-f855916f-6034-4a0c-ac3b-9ae8377eecbb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026066 Apr 08 12:08:20.297527 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1201 bytes} [Thu Apr 8 12:08:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:08:20.307619 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-d53c97fd-9925-4589-85f4-d5cd839bc73e admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:20.321534 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.wsgi [None req-d53c97fd-9925-4589-85f4-d5cd839bc73e admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 12:08:20.322165 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-d53c97fd-9925-4589-85f4-d5cd839bc73e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:08:20.323041 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-d53c97fd-9925-4589-85f4-d5cd839bc73e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019321 Apr 08 12:08:20.324212 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1181 bytes} [Thu Apr 8 12:08:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 12:08:21.882071 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-f855916f-6034-4a0c-ac3b-9ae8377eecbb admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:21.883205 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-f855916f-6034-4a0c-ac3b-9ae8377eecbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Apr 08 12:08:21.883643 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:22.068583 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-a0d12eb5-902d-4d46-840f-e92aeec47fed admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:22.084793 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.wsgi [None req-a0d12eb5-902d-4d46-840f-e92aeec47fed admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 12:08:22.085388 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-a0d12eb5-902d-4d46-840f-e92aeec47fed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:08:22.086232 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-a0d12eb5-902d-4d46-840f-e92aeec47fed admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.072088 Apr 08 12:08:22.086839 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1181 bytes} [Thu Apr 8 12:08:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 12:08:22.097337 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-8674aad6-ec41-41a3-90bc-3aec1a68d546 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:22.118918 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-8674aad6-ec41-41a3-90bc-3aec1a68d546 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025545 Apr 08 12:08:22.119482 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1201 bytes} [Thu Apr 8 12:08:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:08:22.129873 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-6f491f70-289e-497f-a425-9ca3b798da26 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:22.151821 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-6f491f70-289e-497f-a425-9ca3b798da26 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025454 Apr 08 12:08:22.152556 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1201 bytes} [Thu Apr 8 12:08:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:08:22.162262 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-5eecfdb1-54c9-4a22-935e-24c7e8f279e5 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:22.175003 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.wsgi [None req-5eecfdb1-54c9-4a22-935e-24c7e8f279e5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 12:08:22.175623 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-5eecfdb1-54c9-4a22-935e-24c7e8f279e5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:08:22.176466 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-5eecfdb1-54c9-4a22-935e-24c7e8f279e5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017995 Apr 08 12:08:22.177022 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1181 bytes} [Thu Apr 8 12:08:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 12:08:23.749733 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-6f491f70-289e-497f-a425-9ca3b798da26 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:23.751003 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-6f491f70-289e-497f-a425-9ca3b798da26 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Apr 08 12:08:23.751447 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:23.931698 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-0fbcf42d-a055-4498-a818-bf6c72cc3687 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:23.945336 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.wsgi [None req-0fbcf42d-a055-4498-a818-bf6c72cc3687 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 12:08:23.950293 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-0fbcf42d-a055-4498-a818-bf6c72cc3687 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:08:23.950293 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-0fbcf42d-a055-4498-a818-bf6c72cc3687 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.069150 Apr 08 12:08:23.950293 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1184 bytes} [Thu Apr 8 12:08:23 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 12:08:23.957357 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-e9710cc8-8a8c-4237-a328-d4edeb6969f4 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:23.978919 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-e9710cc8-8a8c-4237-a328-d4edeb6969f4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025409 Apr 08 12:08:23.981922 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1201 bytes} [Thu Apr 8 12:08:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:08:23.991014 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:24.013121 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025976 Apr 08 12:08:24.013695 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1201 bytes} [Thu Apr 8 12:08:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:08:24.023823 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-064e0b36-9f37-40f9-8c7b-862742620d35 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:24.037180 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.wsgi [None req-064e0b36-9f37-40f9-8c7b-862742620d35 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 12:08:24.037794 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-064e0b36-9f37-40f9-8c7b-862742620d35 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:08:24.038657 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-064e0b36-9f37-40f9-8c7b-862742620d35 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018629 Apr 08 12:08:24.039200 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1184 bytes} [Thu Apr 8 12:08:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 12:08:25.595653 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:25.596726 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Apr 08 12:08:25.597166 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:25.778904 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-a2275107-4258-4f3c-8179-215c92b5cf52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:08:25.849905 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-a2275107-4258-4f3c-8179-215c92b5cf52 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.124675 Apr 08 12:08:25.850512 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1226 bytes} [Thu Apr 8 12:08:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:08:27.409206 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:27.410290 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Apr 08 12:08:27.410758 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:27.593468 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-4e7dab3c-3e38-4859-8ca5-a5fa3a7715d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:08:27.644345 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-4e7dab3c-3e38-4859-8ca5-a5fa3a7715d8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.105119 Apr 08 12:08:27.644870 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1226 bytes} [Thu Apr 8 12:08:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:08:29.209097 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:29.210177 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Apr 08 12:08:29.210656 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:29.393811 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-37f37979-aafd-45f5-9f7a-f271817fce1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:08:29.495546 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-37f37979-aafd-45f5-9f7a-f271817fce1a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.157007 Apr 08 12:08:29.496125 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1226 bytes} [Thu Apr 8 12:08:29 2021] POST /compute/v2.1/flavors => generated 407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:08:31.059797 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:31.061101 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Apr 08 12:08:31.061538 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:08:31.242533 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-9c488725-c943-40e3-a8b6-5a57d40ca78a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:08:31.303312 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-9c488725-c943-40e3-a8b6-5a57d40ca78a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.113859 Apr 08 12:08:31.303901 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1226 bytes} [Thu Apr 8 12:08:31 2021] POST /compute/v2.1/flavors => generated 409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:08:32.865232 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:32.866294 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Apr 08 12:08:32.866757 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:08:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:08:33.050770 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-0936cacb-f74e-4c0c-8467-1cf0c91cc93f admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:08:33.079273 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-0936cacb-f74e-4c0c-8467-1cf0c91cc93f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082189 Apr 08 12:08:33.079791 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Apr 8 12:08:32 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:09:24.183983 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:09:24.185093 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-650e247e-f3b2-473f-89e7-32e0113de1c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002568 Apr 08 12:09:24.185533 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 31/63] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:09:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:09:24.371739 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-c04c906b-fa3e-4aca-8baf-74537b7be392 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:09:24.400576 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-c04c906b-fa3e-4aca-8baf-74537b7be392 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.083591 Apr 08 12:09:24.401469 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Apr 8 12:09:24 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:11:00.869260 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-0ab930da-dbd1-419a-81f4-74434613b7ee tempest-verify_tempest_config-1648168203 tempest-verify_tempest_config-1648168203-project] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:11:00.871605 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-0ab930da-dbd1-419a-81f4-74434613b7ee tempest-verify_tempest_config-1648168203 tempest-verify_tempest_config-1648168203-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.120272 Apr 08 12:11:00.872195 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 32/65] 10.222.0.43 () {58 vars in 1124 bytes} [Thu Apr 8 12:11:00 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:12:31.594499 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-c04c906b-fa3e-4aca-8baf-74537b7be392 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:12:31.595573 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-c04c906b-fa3e-4aca-8baf-74537b7be392 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Apr 08 12:12:31.596010 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 34/66] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:12:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:12:31.853239 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-4f816279-cf45-408a-beac-8fc5f5d12577 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:12:31.855058 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:12:31.855058 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: warnings.warn(msg) Apr 08 12:12:31.856775 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-4f816279-cf45-408a-beac-8fc5f5d12577 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:12:31.857316 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-4f816279-cf45-408a-beac-8fc5f5d12577 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:12:31.858160 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-4f816279-cf45-408a-beac-8fc5f5d12577 admin admin] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:12:31.858668 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-4f816279-cf45-408a-beac-8fc5f5d12577 admin admin] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:12:31.898427 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-4f816279-cf45-408a-beac-8fc5f5d12577 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.171870 Apr 08 12:12:31.899021 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1184 bytes} [Thu Apr 8 12:12:31 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:12:33.469430 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-c04c906b-fa3e-4aca-8baf-74537b7be392 admin admin] Calling method '>' {{(pid=83744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:12:33.470568 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-c04c906b-fa3e-4aca-8baf-74537b7be392 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Apr 08 12:12:33.471013 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83744|app: 0|req: 35/68] 10.222.0.43 () {56 vars in 1065 bytes} [Thu Apr 8 12:12:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:12:33.656021 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG nova.api.openstack.wsgi [None req-c0f8498c-e870-4bbd-b7d9-685422daf8a3 admin admin] Calling method '>' {{(pid=83745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:12:33.657333 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:12:33.657333 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: warnings.warn(msg) Apr 08 12:12:33.658996 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-c0f8498c-e870-4bbd-b7d9-685422daf8a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:12:33.659487 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-c0f8498c-e870-4bbd-b7d9-685422daf8a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:12:33.660328 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-c0f8498c-e870-4bbd-b7d9-685422daf8a3 admin admin] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:12:33.660807 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: DEBUG oslo_concurrency.lockutils [None req-c0f8498c-e870-4bbd-b7d9-685422daf8a3 admin admin] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:12:33.689364 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: INFO nova.api.openstack.requestlog [None req-c0f8498c-e870-4bbd-b7d9-685422daf8a3 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.088967 Apr 08 12:12:33.689899 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: [pid: 83745|app: 0|req: 34/69] 10.222.0.43 () {60 vars in 1184 bytes} [Thu Apr 8 12:12:33 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:13:28.768646 dv-cinder-784779-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 08 12:13:28.769096 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: Thu Apr 8 12:13:28 2021 - graceful shutdown triggered... Apr 08 12:13:28.769525 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: Gracefully killing worker 1 (pid: 83744)... Apr 08 12:13:28.769736 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: Gracefully killing worker 2 (pid: 83745)... Apr 08 12:13:29.769877 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: worker 1 buried after 1 seconds Apr 08 12:13:29.769877 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: worker 2 buried after 1 seconds Apr 08 12:13:29.769877 dv-cinder-784779-3-iscsi devstack@n-api.service[83743]: goodbye to uWSGI. Apr 08 12:13:29.771526 dv-cinder-784779-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 08 12:13:29.773269 dv-cinder-784779-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 12:13:29.781809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Apr 8 12:13:29 2021] *** Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: nodename: dv-cinder-784779-3-iscsi Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: machine: x86_64 Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: clock source: unix Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: pcre jit disabled Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: detected number of CPU cores: 4 Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: current working directory: / Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: detected binary path: /usr/bin/uwsgi-core Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: dropping root privileges as early as possible Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: your processes number limit is 47843 Apr 08 12:13:29.783919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: your memory page size is 4096 bytes Apr 08 12:13:29.785096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: detected max file descriptor number: 2048 Apr 08 12:13:29.785096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: lock engine: pthread robust mutexes Apr 08 12:13:29.785096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: thunder lock: enabled Apr 08 12:13:29.785096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 12:13:29.785096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: dropping root privileges after socket binding Apr 08 12:13:29.785096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 08 12:13:29.829749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Python main interpreter initialized at 0x558c3b8c89c0 Apr 08 12:13:29.829749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: dropping root privileges after plugin initialization Apr 08 12:13:29.829749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: python threads support enabled Apr 08 12:13:29.829749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: your server socket listen backlog is limited to 100 connections Apr 08 12:13:29.829749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: your mercy for graceful operations on workers is 90 seconds Apr 08 12:13:29.830345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: mapped 402621 bytes (393 KB) for 2 cores Apr 08 12:13:29.830345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: *** Operational MODE: preforking *** Apr 08 12:13:29.830525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: dropping root privileges after application loading Apr 08 12:13:29.830525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: *** uWSGI is running in multiple interpreter mode *** Apr 08 12:13:29.830525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: spawned uWSGI master process (pid: 98472) Apr 08 12:13:29.830578 dv-cinder-784779-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 12:13:29.830877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: spawned uWSGI worker 1 (pid: 98473, cores: 1) Apr 08 12:13:29.831183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: spawned uWSGI worker 2 (pid: 98474, cores: 1) Apr 08 12:13:29.831290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 12:13:34.846061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 08 12:13:34.846703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 08 12:13:34.847998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 08 12:13:34.848446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 08 12:13:34.848748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 08 12:13:34.849218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.849596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.849967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.850353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.850747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.851108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.851478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.851846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.852756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.853067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.853427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.853808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784779-3-iscsi {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.854192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.854815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.854918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.855256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.855609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.855990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.856345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.856970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.857168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 08 12:13:34.857332 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.857485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 08 12:13:34.857651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.858000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.858419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.858784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.859092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 08 12:13:34.859202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.859490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.859596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 08 12:13:34.859774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 08 12:13:34.859868 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.860199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.860301 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.860598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.860716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.860916 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784779-3-iscsi {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.861016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.861274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.861385 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.861627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.861732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.861985 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.862092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.862380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.862480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.862761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.862919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.863132 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.863297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.863448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.863610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.863761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.863904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.864121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784779-3-iscsi {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.864302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.864495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.864665 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.864816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.864960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.865174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.865339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.865546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.865718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.865869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.866018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.866237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.866424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.866613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.866772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.866981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.867236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.867399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.867590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.867749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.868631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.868823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.868973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.869126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.869284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.869437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.869582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.869730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.869885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.870029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.870331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.870505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.870662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.870805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.870959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.871103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.871534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.871677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.872123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784779-3-iscsi {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.872298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.872444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.872592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.872751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.872901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.873054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.873209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.873209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.873491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.873634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.873782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.873932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.874087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.874372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.874543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.874698 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.874852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.875004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.875167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.875416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.875568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.875712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.875855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.876010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.876162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.876396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.876550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.876700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.876843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.876994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.877152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.877393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.877555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.877758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.877910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.878108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.878267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.878481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.878643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.878950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.879109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.879262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.879418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.879570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.879713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.879863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.880019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.880169 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.880339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.880561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.880716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.880867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.881025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.881181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.881333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.881492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.881638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.881788 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.881951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.882473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.882628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.882773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.882933 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883542 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.883998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.884520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.884677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.884828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.884978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.885275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.885522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.885671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.885820 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.885971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.886124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.886288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.886288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.886594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.886743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.886892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.887047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.887198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.887341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.887484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.887628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.887771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.887926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.888078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.888222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.888372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.888515 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.888657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.888813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.889122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.889275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.889419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.889562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.889717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.889873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.890022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.890181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.890390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.890563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.890785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.890785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.891137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.891281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.891424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.891574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.891728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.891872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.892021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.892181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.892644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.892797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.892955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.893102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.893246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.893397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.893541 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.893691 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.893852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.894003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.894154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.894314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.894468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.894736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.894892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.895036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.895184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.895376 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.895653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.895814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.895957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.896110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.896253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.896395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.896546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.896801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.896962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.897111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.897261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.897410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.897553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.897707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.897856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.898006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.898153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.898297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.898476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.898629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.898780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.898932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.899478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.899661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.899859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.900018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.900170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.900323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.900473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.900617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.900617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.901004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.901149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.901312 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.901456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.901599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.901749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.901899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.902047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.902190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.902505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.902845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.903093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.903251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.903395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.903537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.903695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.903844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.903996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.904139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.904288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.904431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.904574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.904824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.904971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.905121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.905270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.905413 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.905561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.905815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.905966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.906237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.906406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.906551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.906704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.906858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.907018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.907163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.907311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.907311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.907584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.907737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 08 12:13:34.907890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.908039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.908189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.908338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.908493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.908643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.908792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.908941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.909083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.909393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.909567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.909720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.909873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.910022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.910166 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.910338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.910504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.910648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.910792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.911016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.911175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.911328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.911472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.911621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.911770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.911924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.912074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.912228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.912372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.912537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.912902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.913060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.913326 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.913485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.913630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.913774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.913917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.914060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.914222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.914454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.915117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.915346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.915497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.915641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.915809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.916028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.916177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.916328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.916474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.916617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.916771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.916930 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.917075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.917223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.917375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.917526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.917670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.917812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.917955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.918103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.918255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.918479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.918634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.918788 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.918931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.919073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.919221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.919529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.919688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.919843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.919999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.920154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.920303 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.920458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.920606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.920756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.920913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.921153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.921317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.921467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.921621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.921777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.921925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.922080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.922240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.922414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.922574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.922759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.923129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.923324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.923570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.923727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.923876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.924033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.924182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.924331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.924487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.924643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.924798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.924949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.925102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.925256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.925503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.925667 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.925817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.925966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.926201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.926391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.926547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.926705 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.926860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.927019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.927281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.927457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.927609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.927766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.927926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.928076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.928230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.928386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.928541 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.928695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.928843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.928991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.929139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.929296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.929470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.929781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.929947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.930104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.930104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.931020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.931258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.931595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.931760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.931971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.932143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.932367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.932524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.932765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.932932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.933328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.933581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.933832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.933989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.934148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.934322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.934494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.934653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.934802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.934957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.935116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.935272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.935442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.935692 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.935855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.936010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.936165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.936418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.936641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.936803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.936953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.937101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.937256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.937412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.937568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.937732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.937881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.938029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.938177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.938344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.938516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.938666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.938821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.938975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.939125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.939272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.939431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.939588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.939917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.940075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.940230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.940379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.940538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.940694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.940849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.941003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.941163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.941408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.941570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.941726 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.941876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.942032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.942180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.942360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.942523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.942673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.942828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.942977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.943131 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.943526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.943690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.943858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.944103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.944265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.944424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.944585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.944740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.944934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.945089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.945261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.945543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.945726 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.945978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.946140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.946290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.946581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.946745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.946911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.947066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.947305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.947467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.947617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.947790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.948028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.948195 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.948354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.948508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.948663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.948818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.948977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.949125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.949283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.949439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.949587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.949743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.950071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.950234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.950419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.950571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.950728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.950878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.951026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.951191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.951345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.951547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.951762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.951915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.952063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.952219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.952368 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.952516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.952673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.952822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.952970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.953135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.953295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.953680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.953844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.954001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.954253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.954463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.954618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.954772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.954941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.955098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.955254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.955416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.955416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.955823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.955990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.956209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.956364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.956519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.956765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.956932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.957081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.957235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.957390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.957539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.957691 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.957847 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.958939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.959230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.959378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.959537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.959686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.959833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.960005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.960312 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.960469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.960627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.960783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.960931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.961079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.961226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.961374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.962078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.962282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.962558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.962723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.962878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.963027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.963183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.963339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.963487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.963892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.964048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.964209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.964477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.964647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.964647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.964945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.965108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.965272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.965427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.965575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.965810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.965965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.966113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.966372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.966530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.966679 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.966921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.967084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.967234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.967400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.967549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.967698 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.967848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.967995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.968149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.968307 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.968456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.968610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.968759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.968916 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.969076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.969235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.969392 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.969539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.969699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.969853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.970014 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.970180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.970503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.970652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.970811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.970966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.971127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.971283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.971437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.971595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.971742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.971896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.972057 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.972213 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.972361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.972509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.972657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.972805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.972964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.973124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.973278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.973441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.973606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.973778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.974172 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.974401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.974669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.974827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.974981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.975142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.975291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.975445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.975601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.975755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.976004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.976167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.976336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.976555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.976715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.976870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.977129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.977129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.977942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.978091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.978239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.978415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.978580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.978739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.978898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.979048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.980052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.980211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.980526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.980684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.980844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.981008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.981171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.981321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.981471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.981619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.981766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.981922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.982077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.982226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.982415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.982575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.982731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.982898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.983942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.984310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.984424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.984598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.984840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.984961 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.985263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.985391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.985504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.985634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.985634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.985866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.986006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.986204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.986347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.986478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.986680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.986800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.986912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.987829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988358 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.988877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.989891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.990150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.990397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.990709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.990822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.990932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.991046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.991203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.991315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.991555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.991666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.991912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.992017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.992264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.992367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.992620 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.992753 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.993007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.993127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.993359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.993485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.993715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.993834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.994067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.994375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.994499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.994778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.995130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.995393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.995498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.995799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.995909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.996399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.996563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.996758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.996929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.997083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.997207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.997442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.997566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.997790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.997905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.998154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.998269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.998554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.998903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.999026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.999264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.999387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.999616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.999745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:34.999973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.000101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.000325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.000452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.000748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.000886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.001008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.001126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.001360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.001488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.001719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.001865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.002082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.002204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.002470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.002597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.002833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.003027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.003150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.003263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.003494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.003616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.003849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.003979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.004204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.004348 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.004544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.004668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.004867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.005001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.005260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.005399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.005567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.005702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.005909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.006037 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.006253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.006452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.006689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.006901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.007030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.007150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.007263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.007464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.007755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.007878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.008117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.008246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.008529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.008673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.008861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.008981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.009210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.009372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.009569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.010239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.010423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.010565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.010672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.010672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.011087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.011449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.011576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.011792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.011893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.012151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.012261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.012504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.012605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.012853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.012977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.013210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.013322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.013589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.013695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.013948 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.014055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.014319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.014439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.014693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.015075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.015286 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.015558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.015739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.015935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.016048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.016292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.016410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.016677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.016791 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.017044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.017165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.017393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.017500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.017744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.017918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.018100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.018280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.018493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.018719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.018815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.019099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.019198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.019481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.019591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.019845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.019942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.020191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.020321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.020535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.020651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.020882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.021002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.021231 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.021346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.021603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.021779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.021955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.022060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.022330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.022439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.022694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.022978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.023102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.023370 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.023501 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.023738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.023873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.024629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.024811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.025118 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.025249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.025470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.026287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.026465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.026585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.026713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.026834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.026834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.027076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.027290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.027411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.027524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.027646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.027770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.027884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.028316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.028449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.028572 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.028703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.028826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.028946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.029060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.029273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.029403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.029633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.029770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.029998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.030105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.030416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.030616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.030795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.030959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.031235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.031399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.031578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.031747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.031924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.032079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.032232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.032385 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.032538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.032703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.032864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.033018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.033183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.033335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.033500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.033672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.033843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.033998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.034150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.034336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.034508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.034822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.035165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.035331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.035483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.035638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.035969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.036151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.036325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.036485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.036634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.036793 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.036943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.037101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.037257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.037407 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.037557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.037713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.037903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.038071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.038245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.038736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.038887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.039089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.039198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.040367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.040482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.040758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.040871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.041117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.041222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.041470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.041577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.041824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.041936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.042175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.042290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.042558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.042680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.042904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.043043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.043258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.043382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.043892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.044038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.044038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.044265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.044265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.044487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.044638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.044901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.045021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.045277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.045391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.045635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.045741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.045995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.046199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.046406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.046693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.046972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.047117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.047353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.047490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.047784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.048010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.048140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.048372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.048496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.048729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.048855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.049080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.049248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.049424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.049540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.049801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.049907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.050176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.050282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.050590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.051230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.051397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.051669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.051799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.051915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.052036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.052159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.052274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.052388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.052500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.052731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.052868 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.053701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.053846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.053969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.054076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.054183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.054294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.054449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.054553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.054773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.054905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.055127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.055308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.055492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.055614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.055827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.055956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.056183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.056322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.056543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.056674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.056889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.057021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.057239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.057364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.057588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.057713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.057936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.058061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.058331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.058471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.058698 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.058828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.059117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.059358 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.059490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.059621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.059744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.059858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.060108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.060299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.060469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.060662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.060836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.061046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.061260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.061393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.061732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.061872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.061994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.062320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.062863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.062982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.063091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.063193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.063394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.063500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.063758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.063869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.064121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.064239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.064479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.064590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.064835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.064947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.065178 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.065292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.065528 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.065634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.065882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.065994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.066234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.066421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.066673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.067028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.067654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.068053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.068248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.068410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.068520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.068761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.068869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.069156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.070002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.070176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.070367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.070538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.070763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.070949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.071230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.071403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.071556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.071775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.071960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.072173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.072283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.072563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.072684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.072905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.073011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.073269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.073380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.073622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.073737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.073970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.074075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.074341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.074476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.074695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.074833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.075051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.075157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.075391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.075502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.075741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.075891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.076091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.076202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.076443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.076560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.076788 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.076965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.077123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.077297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.077453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.077748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.077917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.078074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.078229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.078780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.078947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.079165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.079338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.079687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.079848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.080000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.080154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.080306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.080465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.080584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.080695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.080895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.081078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.081240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.081419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.081575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.081732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.081891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.082090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.082210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.082441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.082599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.082979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.083156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.083400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.083568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.083721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.083884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.084042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.084201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.084355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.084519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.084817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.084978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.085251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.085363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.085518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.085635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.085871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.085981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.086223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089791 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.089947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.090072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.090220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.090351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.090621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.090749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.090828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.090909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.091980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.092203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.092386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.092560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.092679 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.092957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.093072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.093326 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.093459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.093686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.093811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.094040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.094145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.094452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.094817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.095175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.095546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.095849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.096289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.096627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.096891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.097018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.097298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.097433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.097682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.097814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.098036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.098153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.098680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.098825 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.098944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.099074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.099199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.099305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.099523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.099636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.099899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.100085 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.100251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.100364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.100597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.100743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.100931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.101050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.101294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.101400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.101654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.101760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.102003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.102156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.103309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.103567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.103740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.103941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.104102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.104347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.104554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.104744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.104945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.105115 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.105291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.105454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.105591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.105815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.105928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.106173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.106286 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.106574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.106934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.107109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.107302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.107547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.107714 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.107883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.108042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.108194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.108356 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.108509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.108664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.108826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.108996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.109160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.109314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.109506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.109683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.109961 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.110141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.110388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.110554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.110800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.110976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.111139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.111339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.111702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.112090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.112487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.112875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.113281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.113431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.113634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.113769 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.113988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.114159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.114908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.115822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.116013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.116196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.116398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.116580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.116750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.116947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.117162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.117305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.117555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.117793 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.118029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.118208 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.118436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.118702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.119067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.119429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.119794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.119974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.120376 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.120548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.120708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.120839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.121059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.121425 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.121688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.121884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.122078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.122256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.122452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.122680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.122829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.123054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.123191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.123419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.123562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.123814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.123900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.124684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.124841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.124980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.125177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.125298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.125414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.125529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.125657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.125772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.125893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.126041 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.126147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.126256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.126440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.126746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.127092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.127281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.127451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.127612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.127800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.127913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.130406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.130601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.130764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.131025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.131181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.131328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.131499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.131800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.131949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.132107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98473) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 08 12:13:35.132260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.132260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.133083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.133314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.134121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.134410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.134895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.135162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.135545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.135928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.136323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.136699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.137077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.137447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.137882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.138170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.138606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.138996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.139382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.139919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.140140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.140554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.140920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.141381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.141880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 08 12:13:35.142046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98474) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 08 12:13:35.179708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98473) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.180073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98474) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.451200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.context [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6939815c-34f4-422f-95c0-797235378b0a(cell1) {{(pid=98473) load_cells /opt/stack/nova/nova/context.py:466}} Apr 08 12:13:35.451382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.context [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6939815c-34f4-422f-95c0-797235378b0a(cell1) {{(pid=98474) load_cells /opt/stack/nova/nova/context.py:466}} Apr 08 12:13:35.456895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:13:35.457053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:13:35.458808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:13:35.459479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:13:35.459714 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:13:35.459992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:13:35.461956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:13:35.462637 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:13:35.489696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98474) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.496021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98473) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.497246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98474) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.502218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98473) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.524653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98474) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.532816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_db.sqlalchemy.engines [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98473) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 12:13:35.610188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:13:35.610188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: from cryptography.utils import int_from_bytes Apr 08 12:13:35.610603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:13:35.610603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: from cryptography.utils import int_from_bytes Apr 08 12:13:35.616089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:13:35.616089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: from cryptography.utils import int_from_bytes Apr 08 12:13:35.616470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 12:13:35.616470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: from cryptography.utils import int_from_bytes Apr 08 12:13:35.689643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Loading Gnome Apr 08 12:13:35.695098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Loading Gnome Apr 08 12:13:35.710373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Loading Google Apr 08 12:13:35.714386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Loading Windows (alt) Apr 08 12:13:35.716162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Loading Google Apr 08 12:13:35.719098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Loading file Apr 08 12:13:35.719569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Loading Windows (alt) Apr 08 12:13:35.720834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Loading keyczar Apr 08 12:13:35.721301 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Loading multi Apr 08 12:13:35.722205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Loading pyfs Apr 08 12:13:35.724308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Loading file Apr 08 12:13:35.726021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Loading keyczar Apr 08 12:13:35.726535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Loading multi Apr 08 12:13:35.728208 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO keyring.backend [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Loading pyfs Apr 08 12:13:36.109026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:13:36.110292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:13:36.116918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:13:36.117347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:13:36.350401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:13:36.353163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 12:13:36.356576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-fb2c51c6-faa8-4fae-86d6-5c35f214912c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:13:36.359140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WARNING keystonemiddleware.auth_token [None req-803baec9-6010-4f52-8997-d01d287e6d78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 12:13:36.361987 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558c3b8c89c0 pid: 98473 (default app) Apr 08 12:13:36.364553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558c3b8c89c0 pid: 98474 (default app) Apr 08 12:14:18.175458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2029545548", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "3ba216da-ab5f-4265-9387-3aaa52f8d07f"}]}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:18.622648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] validate_networks() for [('3ba216da-ab5f-4265-9387-3aaa52f8d07f', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:14:20.750238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:14:20.751288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:14:20.752003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:14:20.758858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:14:20.759754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:14:20.780156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:20.784815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:20.786085 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:20.787498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:20.839970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:20.853059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for user 12ac1ec4656f4449ac95090c4a6c9b27 and project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:20.880610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:14:20.887497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:14:21.084560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d5425399-9e83-4cf6-b95d-71dec0e4aacf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.738785 Apr 08 12:14:21.087193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:14:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 3744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:14:21.352941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-48cb9a6a-f26d-4f45-b22c-63fa4b2b28a8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:21.353723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-48cb9a6a-f26d-4f45-b22c-63fa4b2b28a8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:23.212777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-48cb9a6a-f26d-4f45-b22c-63fa4b2b28a8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:23.256065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-48cb9a6a-f26d-4f45-b22c-63fa4b2b28a8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1218 microversion: 2.1 time: 2.160583 Apr 08 12:14:23.257587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:21 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1218 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:23.450844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-912150011", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "2fad7ac1-72e3-42fe-bf32-aa760d9db440"}]}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:23.621545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] validate_networks() for [('2fad7ac1-72e3-42fe-bf32-aa760d9db440', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:14:24.277323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:24.278892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:24.299748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:24.314621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:24.316220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:24.318518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:24.711205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:24.753372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b09ec428-4640-48e3-8b0d-e3f52753ca5b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1222 microversion: 2.1 time: 0.481695 Apr 08 12:14:24.754854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:24 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1222 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:25.416759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:14:25.416759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:14:25.417354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:14:25.417745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:14:25.418205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:14:25.439915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:25.440428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:25.441306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:25.441915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:25.463329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Getting quotas for project 4d12229b5ee54bd8b6d2f1758187d5c1. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:25.469397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Getting quotas for user 7ce0cd892246421dac6d1cf8f9d186df and project 4d12229b5ee54bd8b6d2f1758187d5c1. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:25.481887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:14:25.485529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:14:25.706507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f8746d54-f524-475c-8219-91c2cca1165e tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.384273 Apr 08 12:14:25.709710 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 2/4] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:14:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:14:25.733132 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8d610ecc-b6d6-4973-b2f6-802edfd9bcfd tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:25.733818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8d610ecc-b6d6-4973-b2f6-802edfd9bcfd tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:25.773266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:25.774112 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:25.828597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:25.829309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:25.832091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:25.834717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:26.105037 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:26.144472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b1e5ddbb-1f87-4d69-8248-133632c93d5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1278 microversion: 2.1 time: 0.375433 Apr 08 12:14:26.145100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:25 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1278 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:26.381558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8d610ecc-b6d6-4973-b2f6-802edfd9bcfd tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:26.397308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8d610ecc-b6d6-4973-b2f6-802edfd9bcfd tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1214 microversion: 2.1 time: 0.669014 Apr 08 12:14:26.399611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:25 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1214 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:27.165389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:27.165841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:27.177926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:27.179300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:27.180315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:27.181552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:27.419505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-070aedd6-265d-4f58-9aff-11b3208a00ac tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:27.420174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-070aedd6-265d-4f58-9aff-11b3208a00ac tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:27.482864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:27.498188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b2c20c84-3d65-4844-9582-3b69de5d33d1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1276 microversion: 2.1 time: 0.337473 Apr 08 12:14:27.506966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:27 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:27.659592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-070aedd6-265d-4f58-9aff-11b3208a00ac tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:27.678980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-070aedd6-265d-4f58-9aff-11b3208a00ac tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1214 microversion: 2.1 time: 0.264876 Apr 08 12:14:27.679771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:27 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1214 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:28.524723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:28.525527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:28.555587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:28.558195 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:28.559319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:28.563464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:28.699537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:28.700486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:28.716095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:28.719187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:28.721268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:28.731083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:28.975695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:28.989555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d5093c7a-eb88-436f-b72f-cfd3e5255056 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1218 microversion: 2.1 time: 0.295569 Apr 08 12:14:28.990184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 5/9] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:28 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1218 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:29.094436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:29.104482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-24975f1f-ddc6-4823-8000-09a47b7d3d32 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1276 microversion: 2.1 time: 0.584977 Apr 08 12:14:29.105457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 5/10] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:28 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1276 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:29.233311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-890467f7-6f79-499e-9208-d7aede402700 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'create', calling method: .version_select at 0x7f225a341a60>, body: {"keypair": {"name": "tempest-keypair-635349907"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:29.439900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-890467f7-6f79-499e-9208-d7aede402700 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:29.449206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-890467f7-6f79-499e-9208-d7aede402700 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for user d3bca9a02e384de89ed455e272f4ea76 and project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:30.008925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:30.010783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:30.020535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:30.021315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:30.023941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:30.024625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:30.312929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-890467f7-6f79-499e-9208-d7aede402700 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:30.320694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-890467f7-6f79-499e-9208-d7aede402700 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for user d3bca9a02e384de89ed455e272f4ea76 and project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:30.336486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:30.353671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0d62d295-f5e2-4704-b4ba-2bcbc5974970 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1266 microversion: 2.1 time: 0.343178 Apr 08 12:14:30.354524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 6/11] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:30 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:14:30.358525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-890467f7-6f79-499e-9208-d7aede402700 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.353726 Apr 08 12:14:30.358964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 6/12] 10.222.0.43 () {60 vars in 1148 bytes} [Thu Apr 8 12:14:28 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:30.375757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:30.400606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:30.434007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:30.434554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:30.435425 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:30.435921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:31.142364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:31.161758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1c31ec8f-af0f-4927-9d15-2a370fd5784c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1276 microversion: 2.1 time: 0.804873 Apr 08 12:14:31.176932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:30 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1276 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:31.377354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:31.378039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:31.399668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:31.402635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:31.403819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:31.407384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:32.188076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:32.190062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:32.203931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:32.210919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:32.211920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:32.214259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:32.363789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:32.378967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-77a47cc6-15b7-4cc6-81f1-977c242004b5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1284 microversion: 2.1 time: 1.007081 Apr 08 12:14:32.379587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:31 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1284 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:32.478907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:32.499301 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0d5b79c9-9d13-4230-8892-4586b9f930c3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1276 microversion: 2.1 time: 0.317330 Apr 08 12:14:32.500259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 8/15] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:32 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:33.398281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:33.400827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:33.422443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:33.424153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:33.431238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:33.432082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:33.522429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:33.523103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:33.543905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:33.544470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:33.545350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:33.545845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:34.274725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:34.286431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ae02850a-a6a1-4412-b004-d9cc877901cf tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1272 microversion: 2.1 time: 0.892743 Apr 08 12:14:34.291740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:33 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1272 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:35.312119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:35.312802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:35.333744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:35.334912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:35.335786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:35.336287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:35.409338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:35.429559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fc3196f2-3a93-4217-abb5-b103dbeac0a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 1.912277 Apr 08 12:14:35.435559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 9/17] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:33 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:36.485215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:36.486044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:36.508790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:36.509310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:36.510178 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:36.510706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:37.919129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:37.933806 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4166f88d-2b89-4da0-906a-7f929d29bd7b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 1.480481 Apr 08 12:14:37.935091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 10/18] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:36 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:38.296157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:38.312743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e61c8612-da8a-45ea-98d0-0901f7b46700 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 3.004449 Apr 08 12:14:38.334577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 9/19] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:35 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 3028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:38.952289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:38.952963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:38.969505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:38.978957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:38.980060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:38.980745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:39.331200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:39.332051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:39.351988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:39.356771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:39.367890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:39.369206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:40.289045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:40.319682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-07ff34e7-ec0c-43c8-b69d-ab96b8bc3c1e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 1.370806 Apr 08 12:14:40.320472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 11/20] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:38 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:41.346410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:41.347626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:41.363895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:41.367153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:41.368191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:41.368877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:41.536753 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:41.559783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-af34cee0-f337-4d88-9b90-01627e4ef01d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 2.232473 Apr 08 12:14:41.565518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 10/21] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:39 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:42.586366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:42.587652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:42.614736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:42.617020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:42.618055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:42.618814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:42.843720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:42.857205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-eee7c2d8-325c-4613-9b5e-b4d54092ee6f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 1.523771 Apr 08 12:14:42.875207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 12/22] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:41 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:14:43.811414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:43.877185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:43.877978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:43.890164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e741d5e7-07ee-4141-9bb0-1b940ac34734 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 1.309397 Apr 08 12:14:43.892110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:42 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:14:43.894270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:43.897236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:43.898532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:43.900963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:44.763316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:44.797114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-176c74bf-8d66-4e2c-af05-ba08fac22e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 0.920589 Apr 08 12:14:44.798979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 13/24] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:43 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:44.867902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-1d132447-ccc0-4a63-8711-9862401c8f53 req-5fd220f1-2449-4190-aa53-f5ea6450a2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a", "tag": "e462b605-b4cf-4d87-9526-70194bb10bd6"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:44.870624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:14:44.870624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:14:44.882115 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1d132447-ccc0-4a63-8711-9862401c8f53 req-5fd220f1-2449-4190-aa53-f5ea6450a2d9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:44.882794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1d132447-ccc0-4a63-8711-9862401c8f53 req-5fd220f1-2449-4190-aa53-f5ea6450a2d9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:44.904313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-1d132447-ccc0-4a63-8711-9862401c8f53 req-5fd220f1-2449-4190-aa53-f5ea6450a2d9 service nova] Creating event network-changed:e462b605-b4cf-4d87-9526-70194bb10bd6 for instance c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a on hv-cinder-78477 Apr 08 12:14:44.905015 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1d132447-ccc0-4a63-8711-9862401c8f53 req-5fd220f1-2449-4190-aa53-f5ea6450a2d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98474) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 08 12:14:44.906364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1edb985-3e65-4c89-ad56-1d824ea6418b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:44.906945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1edb985-3e65-4c89-ad56-1d824ea6418b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:44.908725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1edb985-3e65-4c89-ad56-1d824ea6418b None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:44.909295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1edb985-3e65-4c89-ad56-1d824ea6418b None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:44.923853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:44.924530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:44.931892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.compute.rpcapi [None req-b1edb985-3e65-4c89-ad56-1d824ea6418b None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 08 12:14:44.933025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1edb985-3e65-4c89-ad56-1d824ea6418b None None] Releasing lock "compute-rpcapi-router" {{(pid=98474) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 08 12:14:44.952519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:44.955291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:44.961252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:44.961824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:44.969536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b1edb985-3e65-4c89-ad56-1d824ea6418b None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169805 Apr 08 12:14:44.973377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:14:45.001803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-617370151", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b1fc7d4-88cb-4a68-a3ed-5bf40dc45f61"}], "security_groups": [{"name": "tempest-securitygroup--1828706072"}], "key_name": "tempest-keypair-635349907", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:45.367294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] validate_networks() for [('6b1fc7d4-88cb-4a68-a3ed-5bf40dc45f61', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:14:45.950833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:45.964755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a50f1d0c-d688-4c8d-8d88-2b0c266ef7fb tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 1.044592 Apr 08 12:14:45.978355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:44 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:14:45.987433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:45.991464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:46.004445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:46.005209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:46.006914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:46.007601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:46.668329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:46.678147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-be7ce31b-e9e2-4caf-9255-6b337a40c600 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 0.698275 Apr 08 12:14:46.681985 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:45 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:47.017500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-974d0236-b3d8-455f-b8ec-df4e6a596287 req-7ee8bc19-8675-4537-aca3-82e9085bfad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02abb1a-c178-42da-8900-5f7177a6c913", "tag": "b7f3ab3c-e833-4264-9ab9-8b7ea6034a56"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:47.020415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:14:47.020415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:14:47.041411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-974d0236-b3d8-455f-b8ec-df4e6a596287 req-7ee8bc19-8675-4537-aca3-82e9085bfad8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:47.042211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-974d0236-b3d8-455f-b8ec-df4e6a596287 req-7ee8bc19-8675-4537-aca3-82e9085bfad8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:47.083434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-974d0236-b3d8-455f-b8ec-df4e6a596287 req-7ee8bc19-8675-4537-aca3-82e9085bfad8 service nova] Creating event network-changed:b7f3ab3c-e833-4264-9ab9-8b7ea6034a56 for instance f02abb1a-c178-42da-8900-5f7177a6c913 on hv-cinder-78477 Apr 08 12:14:47.087022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-974d0236-b3d8-455f-b8ec-df4e6a596287 req-7ee8bc19-8675-4537-aca3-82e9085bfad8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98473) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 08 12:14:47.088526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0c4e7f6-80c6-457c-95a3-a19b1b331845 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:47.096126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0c4e7f6-80c6-457c-95a3-a19b1b331845 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:47.097389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0c4e7f6-80c6-457c-95a3-a19b1b331845 None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:47.098176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0c4e7f6-80c6-457c-95a3-a19b1b331845 None None] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:47.121001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.compute.rpcapi [None req-f0c4e7f6-80c6-457c-95a3-a19b1b331845 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 08 12:14:47.122810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0c4e7f6-80c6-457c-95a3-a19b1b331845 None None] Releasing lock "compute-rpcapi-router" {{(pid=98473) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 08 12:14:47.184419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f0c4e7f6-80c6-457c-95a3-a19b1b331845 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.498599 Apr 08 12:14:47.185672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 16/28] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:14:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:14:47.687221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-792667637", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0c8290d-8b8e-49ce-acce-1e130b343241"}]}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:47.821883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] validate_networks() for [('f0c8290d-8b8e-49ce-acce-1e130b343241', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:14:48.654417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:14:48.654870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:14:48.655398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:14:48.655853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:14:48.656686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:14:48.674218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:48.674749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:48.675589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:48.682243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:48.710713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Getting quotas for project be091e02985d460c96e13347ab2ade1d. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:48.715468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Getting quotas for user 817df72103284a328bb726b6989e405d and project be091e02985d460c96e13347ab2ade1d. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:48.728249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:14:48.731379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:14:48.817624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:14:48.818846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:14:48.819482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:14:48.820003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:14:48.820673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:14:48.836765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:48.837476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:48.838544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:48.839181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:48.858409 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7ae0106b-cb9f-4162-a551-2790c6cccde4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.671159 Apr 08 12:14:48.860162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 17/29] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:14:47 2021] POST /compute/v2.1/servers => generated 383 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:14:48.881723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for project 78e331e206224c7aad5f2f90f7059f26. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:48.886241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for user d3bca9a02e384de89ed455e272f4ea76 and project 78e331e206224c7aad5f2f90f7059f26. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:48.888149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:48.893773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:48.899952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:14:48.904068 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:14:48.906700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:48.907333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:48.908324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:48.908967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:49.129831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-20afbbaf-0719-4b10-b013-8f0fc0a23c1f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.143759 Apr 08 12:14:49.136301 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 13/30] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:14:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 4151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 12:14:49.142902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:49.143776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:49.153711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:49.154466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:49.155459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:49.156113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:49.478267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:49.490674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5d6112dd-b9a0-4d47-9545-f82c8a0324e9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 0.629098 Apr 08 12:14:49.494899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 18/31] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:48 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:49.506810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-174f68f8-c4f0-40a0-bd63-0e8ff7211c51 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:49.508252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-174f68f8-c4f0-40a0-bd63-0e8ff7211c51 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:49.666289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-174f68f8-c4f0-40a0-bd63-0e8ff7211c51 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:49.682156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-174f68f8-c4f0-40a0-bd63-0e8ff7211c51 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1221 microversion: 2.1 time: 0.185803 Apr 08 12:14:49.682794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 19/32] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:49 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:49.695056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ae89175d-dbd5-4d0a-b291-3336727dd95a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:49.696009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ae89175d-dbd5-4d0a-b291-3336727dd95a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:49.898291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ae89175d-dbd5-4d0a-b291-3336727dd95a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:49.910619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ae89175d-dbd5-4d0a-b291-3336727dd95a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1236 microversion: 2.1 time: 0.226464 Apr 08 12:14:49.912756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 20/33] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:49 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1236 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:49.936299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:49.977622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-eb376093-c7d8-497f-bb3b-09f2f3bd5329 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 0.826230 Apr 08 12:14:49.978395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 14/34] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:49 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:49.990762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1850639638", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0c8290d-8b8e-49ce-acce-1e130b343241"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:50.202802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b5121a3-9816-48c8-9c10-93a0fdabe785 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'create', calling method: .version_select at 0x7f22599a5b70>, body: {"keypair": {"name": "tempest-keypair-1139061042"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:50.258404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] validate_networks() for [('f0c8290d-8b8e-49ce-acce-1e130b343241', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:14:50.279477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-8b5121a3-9816-48c8-9c10-93a0fdabe785 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:50.284638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-8b5121a3-9816-48c8-9c10-93a0fdabe785 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for user 003e0d5d02fb4268a1122538eb880dd5 and project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:50.612733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-8b5121a3-9816-48c8-9c10-93a0fdabe785 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:50.618543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-8b5121a3-9816-48c8-9c10-93a0fdabe785 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for user 003e0d5d02fb4268a1122538eb880dd5 and project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:50.637023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b5121a3-9816-48c8-9c10-93a0fdabe785 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.722845 Apr 08 12:14:50.638130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 21/35] 10.222.0.43 () {62 vars in 1189 bytes} [Thu Apr 8 12:14:49 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 725 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 08 12:14:50.643357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:50.644225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:50.654493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:50.655298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:50.656818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:50.657814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:50.966432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:50.978756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-01794c57-56ce-4869-bc3e-507d888b6d8a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 0.339226 Apr 08 12:14:50.979408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 22/36] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:50 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:50.984290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:50.984953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:50.998131 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:50.998679 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:50.999533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:51.000006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:51.205780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:51.215790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-40c0672b-9eb2-454b-9c35-c1fb7f13f1a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1240 microversion: 2.1 time: 0.235222 Apr 08 12:14:51.222401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 23/37] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:50 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1240 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:51.228462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:51.229313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:51.241317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:51.241829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:51.243045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:51.243548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:51.543883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:51.556994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5d9a6300-f63c-4802-93ee-4fb86fcc95bc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 0.333180 Apr 08 12:14:51.561306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 24/38] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:51 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:52.000284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:52.001534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:52.014549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:52.015257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:52.016264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:52.016890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:52.681715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:14:52.681715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:14:52.681715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:14:52.681715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:14:52.681715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:14:52.683899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:52.683899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:52.683899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:52.683899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:52.685063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Getting quotas for project be091e02985d460c96e13347ab2ade1d. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:14:52.685063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Getting quotas for user 817df72103284a328bb726b6989e405d and project be091e02985d460c96e13347ab2ade1d. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:14:52.685063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:14:52.685519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:14:52.685786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:52.685786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0088a643-de0b-44d2-bcfb-93177c6b2f34 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 0.655528 Apr 08 12:14:52.685786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 25/39] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:51 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:52.685786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:52.686258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:52.686258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:52.686258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:52.686258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:52.686636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:52.926433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-eb6f829b-3786-47ed-bd73-7372b678da22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.946651 Apr 08 12:14:52.947709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 15/40] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:14:49 2021] POST /compute/v2.1/servers => generated 383 bytes in 2969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:14:52.965535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:52.973881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:52.979818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:52.987466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4b608282-cb97-48b3-bd90-13cd40b6f76b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1288 microversion: 2.1 time: 0.334260 Apr 08 12:14:52.993627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 26/41] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:52 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1288 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:53.001392 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3be5ea65-763f-4f57-8a1f-e2f17dfaa375 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:53.007086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:53.009128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:53.010087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3be5ea65-763f-4f57-8a1f-e2f17dfaa375 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:53.011197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:53.011635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:53.237647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3be5ea65-763f-4f57-8a1f-e2f17dfaa375 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:53.249293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3be5ea65-763f-4f57-8a1f-e2f17dfaa375 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1222 microversion: 2.1 time: 0.253914 Apr 08 12:14:53.250451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 27/42] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:52 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:53.690822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:53.694096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:53.732632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:53.733154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:53.734035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:53.740027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:54.072596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:54.083204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2ff91a7c-48d5-4396-a201-5a2eb4f7edc5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 1.133964 Apr 08 12:14:54.083861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 16/43] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:52 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:54.096959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:54.107811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:54.138126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:54.140741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:54.141855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:54.142529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:54.544344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:54.566716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-21013292-133b-479d-b881-19c1bf68acef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1294 microversion: 2.1 time: 0.473492 Apr 08 12:14:54.572790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 17/44] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:54 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1294 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:54.578147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:54.591306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:54.619713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:54.622452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:54.622452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:54.622452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:54.685345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:54.701534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c092e443-466f-4738-a56e-b6932515f3e5 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 1.017940 Apr 08 12:14:54.702720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 28/45] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:53 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:14:55.083949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:55.094619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9ea8cfe9-343a-4e50-907b-a40174678396 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1274 microversion: 2.1 time: 0.520157 Apr 08 12:14:55.095580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 18/46] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:54 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1274 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:55.101492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:55.102170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:55.113817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:55.116625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:55.116625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:55.116625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:55.595911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:55.596623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:55.606257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:55.610943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:55.616935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:55.617631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:55.941200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:55.971402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-43614a4b-ea1a-46b8-8995-4d14b671a5af tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1294 microversion: 2.1 time: 0.370584 Apr 08 12:14:55.971402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 19/47] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:55 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1294 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:55.971402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:55.971402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:55.995406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:55.996420 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:56.000631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:56.001143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:56.385570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:56.415639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2f07d1b2-c1d1-4f44-b9ff-41e16a33f91e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 1.319040 Apr 08 12:14:56.416757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 29/48] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:55 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:14:56.430477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:56.431124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:56.447950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:56.448463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:56.449335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:56.449828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:56.655209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:56.671555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-10a9f887-43d2-43d6-beca-0e1bd611090a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1280 microversion: 2.1 time: 0.253433 Apr 08 12:14:56.672426 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 30/49] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:56 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:56.861393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:56.881982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-01c8588f-1a50-4059-bd96-78e0e7bdc721 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 0.912719 Apr 08 12:14:56.884161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 20/50] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:55 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:56.982557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:56.983251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:57.024859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:57.025712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:57.026872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:57.027925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:57.436319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:57.436992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:57.455152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:57.455625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:57.459889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:57.460404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:58.350899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:58.359872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-45b655ff-6e2e-47ba-badc-9d7c809e2fd3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 0.929690 Apr 08 12:14:58.367177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 21/51] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:57 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:58.367177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:58.367177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:58.374674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:58.375471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:58.376326 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:58.376828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:58.849394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:58.858458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d7bff602-4a5f-4ebc-b1fd-306e4e108efa tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1362 microversion: 2.1 time: 1.880738 Apr 08 12:14:58.859082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 31/52] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:56 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1362 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:58.863739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:58.864407 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:14:58.872967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:58.873536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:58.874400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:14:58.874905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:14:58.966601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:58.966601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2d431a9f-babf-43c2-a2c7-72089c476b30 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 0.601413 Apr 08 12:14:58.966601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 22/53] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:58 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:59.326077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-760091885", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "869b82a0-8157-44c7-88c1-711d14519eb3"}], "security_groups": [{"name": "tempest-securitygroup--637138918"}], "key_name": "tempest-keypair-1139061042", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:14:59.957170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:14:59.980813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-01d2db42-c34d-44dd-89c9-91c32f261986 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 1.120561 Apr 08 12:14:59.982603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 32/54] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:58 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:14:59.987313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:14:59.989182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:00.001810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:00.002160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:00.003052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:00.003601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:00.221463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] validate_networks() for [('869b82a0-8157-44c7-88c1-711d14519eb3', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:15:01.457200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:01.467331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-11913dff-82a7-4c9e-b5c5-4a903c2b4a89 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 1.484150 Apr 08 12:15:01.468107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 33/55] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:14:59 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:01.483410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:01.485708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:01.498452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:01.499233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:01.500929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:01.501603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:01.741992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:15:01.743093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:15:01.743656 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:15:01.744123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:15:01.744573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:15:01.753846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:01.754388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:01.755300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:01.755777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:01.775076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for project d8fb1b381792465a82ef64be541e5500. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:15:01.779466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for user 003e0d5d02fb4268a1122538eb880dd5 and project d8fb1b381792465a82ef64be541e5500. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:15:01.791594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:15:01.794250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:15:01.888044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0b36377d-023d-4f6a-8bbe-7eefdb91a7e0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.566877 Apr 08 12:15:01.889083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 23/56] 10.222.0.43 () {62 vars in 1178 bytes} [Thu Apr 8 12:14:59 2021] POST /compute/v2.1/servers => generated 401 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 08 12:15:02.067818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-e4598a0a-bf31-4504-9fbb-c5316434a98d req-3c91f7e5-5532-4b7d-a72f-882ca100ee91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a", "name": "network-vif-plugged", "status": "completed", "tag": "e462b605-b4cf-4d87-9526-70194bb10bd6"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:02.072813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:02.072813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:02.078475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:02.085221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e4598a0a-bf31-4504-9fbb-c5316434a98d req-3c91f7e5-5532-4b7d-a72f-882ca100ee91 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:02.086183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e4598a0a-bf31-4504-9fbb-c5316434a98d req-3c91f7e5-5532-4b7d-a72f-882ca100ee91 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:02.096703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b7f8e58e-b0e7-459c-9c27-6d0c424462cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1362 microversion: 2.1 time: 0.617802 Apr 08 12:15:02.097586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 34/57] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:01 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:02.103198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:02.109346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:02.112993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-e4598a0a-bf31-4504-9fbb-c5316434a98d req-3c91f7e5-5532-4b7d-a72f-882ca100ee91 service nova] Creating event network-vif-plugged:e462b605-b4cf-4d87-9526-70194bb10bd6 for instance c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a on hv-cinder-78477 Apr 08 12:15:02.119876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-e4598a0a-bf31-4504-9fbb-c5316434a98d req-3c91f7e5-5532-4b7d-a72f-882ca100ee91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223197 Apr 08 12:15:02.120908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 24/58] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:02.122257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:02.122858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:02.123656 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:02.124154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:02.148616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-ca20bc5f-2139-4b8e-83cb-c776db637ef1 req-853b1b08-dde3-41f9-94d5-83ef5e80ec18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5318a0d2-3723-47d4-9ec0-700cbb4cab5b", "tag": "f711e7c2-6722-4058-8a3c-5703f7eafe86"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:02.151220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:02.151220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:02.164901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ca20bc5f-2139-4b8e-83cb-c776db637ef1 req-853b1b08-dde3-41f9-94d5-83ef5e80ec18 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:02.165699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ca20bc5f-2139-4b8e-83cb-c776db637ef1 req-853b1b08-dde3-41f9-94d5-83ef5e80ec18 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:02.227205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-ca20bc5f-2139-4b8e-83cb-c776db637ef1 req-853b1b08-dde3-41f9-94d5-83ef5e80ec18 service nova] Creating event network-changed:f711e7c2-6722-4058-8a3c-5703f7eafe86 for instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b on hv-cinder-78477 Apr 08 12:15:02.250067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-ca20bc5f-2139-4b8e-83cb-c776db637ef1 req-853b1b08-dde3-41f9-94d5-83ef5e80ec18 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123837 Apr 08 12:15:02.252252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 25/59] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:02.260779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:02.263000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:02.273116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:02.274104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:02.275182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:02.275826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:02.847677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:02.863580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d921004c-f090-4071-855b-bd0ed7565d8d tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 0.608581 Apr 08 12:15:02.871477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 26/60] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:02 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:02.886557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-7b3e38b3-0661-4d1a-aa9c-a740178e00e8 req-0b21984e-5714-49e9-b8d1-0f9a89ba6133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63b515b-cd97-4a20-a16f-7b1f3eba4460", "tag": "6bd89475-0e5a-4d22-a292-0f3eb6e0a648"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:02.893384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:02.893384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:02.913940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-7b3e38b3-0661-4d1a-aa9c-a740178e00e8 req-0b21984e-5714-49e9-b8d1-0f9a89ba6133 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:02.915617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-7b3e38b3-0661-4d1a-aa9c-a740178e00e8 req-0b21984e-5714-49e9-b8d1-0f9a89ba6133 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:02.942901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-7b3e38b3-0661-4d1a-aa9c-a740178e00e8 req-0b21984e-5714-49e9-b8d1-0f9a89ba6133 service nova] Creating event network-changed:6bd89475-0e5a-4d22-a292-0f3eb6e0a648 for instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 on hv-cinder-78477 Apr 08 12:15:02.948627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-7b3e38b3-0661-4d1a-aa9c-a740178e00e8 req-0b21984e-5714-49e9-b8d1-0f9a89ba6133 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075469 Apr 08 12:15:02.949519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 27/61] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:02.955716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-16b382c7-a3f2-4dc3-b059-b6f4edb5a514 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:02.956751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-16b382c7-a3f2-4dc3-b059-b6f4edb5a514 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:03.066397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:03.083989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-437ba11c-a4d8-4b3a-a8dc-fc7f2ddd41c8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 0.984573 Apr 08 12:15:03.088108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 35/62] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:02 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:03.094364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:03.095234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:03.100401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-16b382c7-a3f2-4dc3-b059-b6f4edb5a514 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:03.107975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:03.110010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:03.113162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:03.113904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:03.120757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-16b382c7-a3f2-4dc3-b059-b6f4edb5a514 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:03.125568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-16b382c7-a3f2-4dc3-b059-b6f4edb5a514 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:03.127313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-16b382c7-a3f2-4dc3-b059-b6f4edb5a514 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1281 microversion: 2.20 time: 0.176399 Apr 08 12:15:03.142593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 28/63] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:02 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:03.155285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:03.157355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:03.181021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:03.182023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:03.185545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:03.186424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:03.760075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:03.769824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e148d8f1-56bf-4e54-b108-a08ce9877499 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1318 microversion: 2.1 time: 0.680305 Apr 08 12:15:03.770472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 36/64] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:03 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:03.889556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:03.890272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:03.917906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:03.918472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:03.924418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:03.925176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:04.031193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:04.046149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9bbce76b-61c9-4fac-b5e6-f4f8133be2c9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1362 microversion: 2.1 time: 0.901672 Apr 08 12:15:04.047023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 29/65] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:03 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1362 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:04.106524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:04.107471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:04.118746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:04.119543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:04.120604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:04.121518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:04.650725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:04.669483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8de2b6e3-dd70-4a89-ac77-dcf739934c6b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 0.784062 Apr 08 12:15:04.670702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 37/66] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:03 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:04.682007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:04.691589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:04.722105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:04.724306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:04.727379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:04.732144 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:05.099880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:05.117197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:05.121776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:05.124525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d4e30357-3e3d-49a9-8c03-d5890227555a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1341 microversion: 2.20 time: 0.448609 Apr 08 12:15:05.137243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 38/67] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:04 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1341 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:05.157542 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-4b4854c4-5838-4ed1-b97d-f3566894cb55 req-89c081cd-1b12-415f-b779-8f037b1cf2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02abb1a-c178-42da-8900-5f7177a6c913", "name": "network-vif-plugged", "status": "completed", "tag": "b7f3ab3c-e833-4264-9ab9-8b7ea6034a56"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:05.159732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:05.159732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:05.181206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-4b4854c4-5838-4ed1-b97d-f3566894cb55 req-89c081cd-1b12-415f-b779-8f037b1cf2c4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:05.181971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-4b4854c4-5838-4ed1-b97d-f3566894cb55 req-89c081cd-1b12-415f-b779-8f037b1cf2c4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:05.220641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:05.223161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-4b4854c4-5838-4ed1-b97d-f3566894cb55 req-89c081cd-1b12-415f-b779-8f037b1cf2c4 service nova] Creating event network-vif-plugged:b7f3ab3c-e833-4264-9ab9-8b7ea6034a56 for instance f02abb1a-c178-42da-8900-5f7177a6c913 on hv-cinder-78477 Apr 08 12:15:05.236418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-4b4854c4-5838-4ed1-b97d-f3566894cb55 req-89c081cd-1b12-415f-b779-8f037b1cf2c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097377 Apr 08 12:15:05.237801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 39/68] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:05.238544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5277e9b8-3369-4f04-84c5-b49d1178e89d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 1.133210 Apr 08 12:15:05.239184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 30/69] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:04 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:05.252878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-531d2759-f1e7-4e96-9c18-df6dc8700718 req-82f5e8f1-5827-4485-8cfa-bd6f913ea69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621d3032-5955-4802-8608-e77c44fb5846", "tag": "c6bbbadb-8a8e-4ec6-b503-169a587e171f"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:05.255646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:05.255646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:05.261304 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:05.263842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:05.279020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:05.281374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-531d2759-f1e7-4e96-9c18-df6dc8700718 req-82f5e8f1-5827-4485-8cfa-bd6f913ea69a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:05.281854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-531d2759-f1e7-4e96-9c18-df6dc8700718 req-82f5e8f1-5827-4485-8cfa-bd6f913ea69a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:05.283773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:05.286867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:05.290210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:05.334758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-531d2759-f1e7-4e96-9c18-df6dc8700718 req-82f5e8f1-5827-4485-8cfa-bd6f913ea69a service nova] Creating event network-changed:c6bbbadb-8a8e-4ec6-b503-169a587e171f for instance 621d3032-5955-4802-8608-e77c44fb5846 on hv-cinder-78477 Apr 08 12:15:05.346252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-531d2759-f1e7-4e96-9c18-df6dc8700718 req-82f5e8f1-5827-4485-8cfa-bd6f913ea69a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104259 Apr 08 12:15:05.347261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 31/70] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:05.357841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:05.358898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:05.424486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:05.425123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:05.427962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:05.433487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:06.031424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:06.054553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-381837bd-0f93-4100-9378-e7819322941c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1362 microversion: 2.1 time: 0.705753 Apr 08 12:15:06.056280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 32/71] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:05 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1362 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:06.064947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:06.066463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:06.077266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:06.093804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cc5f22c0-bc01-4d73-865b-e056eab65681 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1508 microversion: 2.1 time: 0.843115 Apr 08 12:15:06.095044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:06.096677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:06.102365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:06.102973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 40/72] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:05 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:06.105621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:06.144625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:06.145828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:06.160371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:06.166649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:06.169818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:06.170544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:06.416347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:06.431502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:06.437265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:06.443904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-057a3464-b679-41d0-a247-832c087acd35 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1339 microversion: 2.20 time: 0.298683 Apr 08 12:15:06.443904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 41/73] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:06 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1339 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:06.450611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:06.451672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:06.485220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:06.485955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:06.488500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:06.490001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:06.521997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:06.532533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0d4fd3a8-7105-4376-980d-e2847cd7151a tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1314 microversion: 2.1 time: 0.473389 Apr 08 12:15:06.533442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 33/74] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:06 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:07.077773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:07.080863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:07.102674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:07.104539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:07.105511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:07.106664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:07.276218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:07.288490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e69ff5a5-601a-4aa2-9be4-09aff21b80b0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 0.842520 Apr 08 12:15:07.289864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 42/75] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:06 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:07.307789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-4c714e64-3702-47bc-8681-9f4e6e1e9be1 req-ac5b05a7-f8ca-400c-b9a8-7c1fa5146741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5318a0d2-3723-47d4-9ec0-700cbb4cab5b", "name": "network-vif-plugged", "status": "completed", "tag": "f711e7c2-6722-4058-8a3c-5703f7eafe86"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:07.309795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:07.309795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:07.321811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-4c714e64-3702-47bc-8681-9f4e6e1e9be1 req-ac5b05a7-f8ca-400c-b9a8-7c1fa5146741 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:07.322669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-4c714e64-3702-47bc-8681-9f4e6e1e9be1 req-ac5b05a7-f8ca-400c-b9a8-7c1fa5146741 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:07.344262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-4c714e64-3702-47bc-8681-9f4e6e1e9be1 req-ac5b05a7-f8ca-400c-b9a8-7c1fa5146741 service nova] Creating event network-vif-plugged:f711e7c2-6722-4058-8a3c-5703f7eafe86 for instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b on hv-cinder-78477 Apr 08 12:15:07.351590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-4c714e64-3702-47bc-8681-9f4e6e1e9be1 req-ac5b05a7-f8ca-400c-b9a8-7c1fa5146741 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048337 Apr 08 12:15:07.353686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 43/76] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:07.463875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:07.465188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:07.482755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:07.483503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:07.484553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:07.485238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:07.872574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:07.900755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-98d6428f-5a24-424c-9eab-b7d378c0c284 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1362 microversion: 2.1 time: 0.830992 Apr 08 12:15:07.901387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 34/77] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:07 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1362 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:07.907641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:07.919179 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:07.936490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:07.937252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:07.940108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:07.943960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:08.040659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:08.065843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:08.068984 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:08.071361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-650644ea-9e33-467c-829d-f4786ffb1eca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.612817 Apr 08 12:15:08.074618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 44/78] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:07 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:08.307645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:08.308891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:08.324717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:08.326775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:08.329525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:08.330235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:08.491055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:08.500505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-21fbd8b1-7170-4c06-9b93-f9e9fd6f271b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1502 microversion: 2.1 time: 0.597742 Apr 08 12:15:08.501391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 35/79] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:07 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1502 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:08.765313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:08.774829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1f4dc9fb-2a2b-47cf-805b-53315fac9c77 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 0.470977 Apr 08 12:15:08.776569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 45/80] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:08 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:08.884113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2e1c2251-d8a3-4862-a745-53a570e225d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6efb2dec-2eb7-4786-bfaf-622c3f8b780c"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:08.886471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2e1c2251-d8a3-4862-a745-53a570e225d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:08.894798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e1c2251-d8a3-4862-a745-53a570e225d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:08.896654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e1c2251-d8a3-4862-a745-53a570e225d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:08.897751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e1c2251-d8a3-4862-a745-53a570e225d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:08.898473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e1c2251-d8a3-4862-a745-53a570e225d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:08.921576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:08.922497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:08.939589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:08.945393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:08.951236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:08.952006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:09.338635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:09.349415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c784633a-d001-411a-8915-62057423eada tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1362 microversion: 2.1 time: 0.434646 Apr 08 12:15:09.359462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 46/81] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:08 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:09.360401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:09.361068 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:09.408004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:09.408578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:09.409363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:09.409857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:09.814904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:09.835837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:09.838556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:09.844287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9b952be4-2623-4fdf-b98f-b49784e9e645 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.485140 Apr 08 12:15:09.844945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 47/82] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:09 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:09.877395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-1f75fe08-457f-4db0-9acb-9db34001ac03 req-a130d143-839d-4474-b679-b9a37633620a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63b515b-cd97-4a20-a16f-7b1f3eba4460", "name": "network-vif-plugged", "status": "completed", "tag": "6bd89475-0e5a-4d22-a292-0f3eb6e0a648"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:09.881229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:09.881229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:09.901284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1f75fe08-457f-4db0-9acb-9db34001ac03 req-a130d143-839d-4474-b679-b9a37633620a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:09.901795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1f75fe08-457f-4db0-9acb-9db34001ac03 req-a130d143-839d-4474-b679-b9a37633620a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:09.951874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-1f75fe08-457f-4db0-9acb-9db34001ac03 req-a130d143-839d-4474-b679-b9a37633620a service nova] Creating event network-vif-plugged:6bd89475-0e5a-4d22-a292-0f3eb6e0a648 for instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 on hv-cinder-78477 Apr 08 12:15:09.973203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-1f75fe08-457f-4db0-9acb-9db34001ac03 req-a130d143-839d-4474-b679-b9a37633620a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124203 Apr 08 12:15:09.981906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 48/83] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:09.990401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-01e8e235-ef56-439c-b3d6-806c0808fc01 req-7280ec69-9c6d-47d4-ab0b-1b9832fa3cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704586d7-ad35-414f-af0c-5835b542f260", "tag": "53f6e72e-034c-4c1c-be6e-8d0a69255cf0"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:09.994777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:09.994777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:10.013865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-01e8e235-ef56-439c-b3d6-806c0808fc01 req-7280ec69-9c6d-47d4-ab0b-1b9832fa3cad service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.014768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-01e8e235-ef56-439c-b3d6-806c0808fc01 req-7280ec69-9c6d-47d4-ab0b-1b9832fa3cad service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.047994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-01e8e235-ef56-439c-b3d6-806c0808fc01 req-7280ec69-9c6d-47d4-ab0b-1b9832fa3cad service nova] Creating event network-changed:53f6e72e-034c-4c1c-be6e-8d0a69255cf0 for instance 704586d7-ad35-414f-af0c-5835b542f260 on hv-cinder-78477 Apr 08 12:15:10.054581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-01e8e235-ef56-439c-b3d6-806c0808fc01 req-7280ec69-9c6d-47d4-ab0b-1b9832fa3cad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070517 Apr 08 12:15:10.055943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 49/84] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:10.063217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:10.064189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:10.076188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.077756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.079041 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.079732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.441194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:10.461700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-32f16a21-b4ec-43f0-8dc9-9fa3fd142440 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 0.403604 Apr 08 12:15:10.463050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 50/85] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:10 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:10.469148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:10.470099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:10.484512 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.485499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.486573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.487582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.522171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2e1c2251-d8a3-4862-a745-53a570e225d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.642238 Apr 08 12:15:10.523475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 36/86] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:15:08 2021] POST /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a/os-volume_attachments => generated 194 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:10.840995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dbd56ed1-3f2a-40ce-8292-bf4abb67e045 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c9842ef-2bab-4e9a-8620-408fd2f992b0"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:10.843433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dbd56ed1-3f2a-40ce-8292-bf4abb67e045 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:10.856782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dbd56ed1-3f2a-40ce-8292-bf4abb67e045 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.858775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dbd56ed1-3f2a-40ce-8292-bf4abb67e045 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.860355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dbd56ed1-3f2a-40ce-8292-bf4abb67e045 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.861175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dbd56ed1-3f2a-40ce-8292-bf4abb67e045 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.894559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:10.908561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a82c0685-bdce-40f4-aa49-259a3dde5906 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1547 microversion: 2.1 time: 0.444398 Apr 08 12:15:10.922329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 51/87] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:10 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1547 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:10.924142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:10.927719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:10.948401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.952091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:10.953262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:10.953962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:11.292246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:11.319075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:11.324203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:11.325576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dc6b6b55-a4bc-4c0c-a86f-04e94ab6502f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.406753 Apr 08 12:15:11.326397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 52/88] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:10 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:11.331744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8dfd9584-35a1-4d6c-9656-f9aad51005c5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:11.332295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8dfd9584-35a1-4d6c-9656-f9aad51005c5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:11.340501 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8dfd9584-35a1-4d6c-9656-f9aad51005c5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:11.341019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8dfd9584-35a1-4d6c-9656-f9aad51005c5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:11.341860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8dfd9584-35a1-4d6c-9656-f9aad51005c5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:11.342378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8dfd9584-35a1-4d6c-9656-f9aad51005c5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:11.529465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8dfd9584-35a1-4d6c-9656-f9aad51005c5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201744 Apr 08 12:15:11.530319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 53/89] 10.222.0.43 () {58 vars in 1265 bytes} [Thu Apr 8 12:15:11 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:11.537729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:11.537729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:11.545570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:11.546281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:11.547486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:11.548177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:11.973104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dbd56ed1-3f2a-40ce-8292-bf4abb67e045 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "POST /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138835 Apr 08 12:15:11.975006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 37/90] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:15:10 2021] POST /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913/os-volume_attachments => generated 194 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:12.040631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:12.050069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f23317f7-a123-4f94-978f-6bc0684368a9 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 0.518428 Apr 08 12:15:12.050718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 54/91] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:11 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:12.276445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-1ca75068-1b3a-4632-8d6c-e513b46e9d4c req-d73cdf15-f948-4def-8f49-2e3ad4319aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621d3032-5955-4802-8608-e77c44fb5846", "name": "network-vif-plugged", "status": "completed", "tag": "c6bbbadb-8a8e-4ec6-b503-169a587e171f"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:12.280967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:12.280967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:12.299308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1ca75068-1b3a-4632-8d6c-e513b46e9d4c req-d73cdf15-f948-4def-8f49-2e3ad4319aa9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:12.299822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1ca75068-1b3a-4632-8d6c-e513b46e9d4c req-d73cdf15-f948-4def-8f49-2e3ad4319aa9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:12.337996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-1ca75068-1b3a-4632-8d6c-e513b46e9d4c req-d73cdf15-f948-4def-8f49-2e3ad4319aa9 service nova] Creating event network-vif-plugged:c6bbbadb-8a8e-4ec6-b503-169a587e171f for instance 621d3032-5955-4802-8608-e77c44fb5846 on hv-cinder-78477 Apr 08 12:15:12.345438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-1ca75068-1b3a-4632-8d6c-e513b46e9d4c req-d73cdf15-f948-4def-8f49-2e3ad4319aa9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074480 Apr 08 12:15:12.347076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 38/92] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:12.347821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:12.348669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:12.366990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:12.367618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:12.368557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:12.369130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:12.866595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:12.876332 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:12.877975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:12.879160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4a8da2ec-7d66-4a35-bedf-6144e333cd88 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.538241 Apr 08 12:15:12.879852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 55/93] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:12 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:13.070084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:13.070897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:13.079809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:13.080327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:13.081185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:13.081686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:13.343612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:13.356556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7952e91e-8baf-4451-ac58-95ab2c9a94ab tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1322 microversion: 2.1 time: 0.291024 Apr 08 12:15:13.367210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 39/94] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:13 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:13.900574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:13.901238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:13.919547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:13.925485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:13.931387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:13.932322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.374285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:14.376704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-af260f9e-4de3-4b60-9f61-6c114f2b4c6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:14.378210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-af260f9e-4de3-4b60-9f61-6c114f2b4c6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:14.394426 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af260f9e-4de3-4b60-9f61-6c114f2b4c6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:14.396521 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af260f9e-4de3-4b60-9f61-6c114f2b4c6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.399319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af260f9e-4de3-4b60-9f61-6c114f2b4c6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:14.404582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:14.405185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af260f9e-4de3-4b60-9f61-6c114f2b4c6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.414237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:14.415507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8ff5240c-3a82-4b11-8233-9c88dfbb31d0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.520513 Apr 08 12:15:14.418802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 56/95] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:13 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:14.436644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:14.441611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:14.463171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:14.464010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.465040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:14.465675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.579775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-af260f9e-4de3-4b60-9f61-6c114f2b4c6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 0.207073 Apr 08 12:15:14.580700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 40/96] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:14 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:15:14.589762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-58ed187d-9bbb-493a-b3fb-23d5f888e656 req-50b43f66-649b-4f6a-84e1-c5b4dfe55a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5318a0d2-3723-47d4-9ec0-700cbb4cab5b", "tag": "f711e7c2-6722-4058-8a3c-5703f7eafe86"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:14.592288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:14.592288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:14.603428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-58ed187d-9bbb-493a-b3fb-23d5f888e656 req-50b43f66-649b-4f6a-84e1-c5b4dfe55a5c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:14.604339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-58ed187d-9bbb-493a-b3fb-23d5f888e656 req-50b43f66-649b-4f6a-84e1-c5b4dfe55a5c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.624763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-58ed187d-9bbb-493a-b3fb-23d5f888e656 req-50b43f66-649b-4f6a-84e1-c5b4dfe55a5c service nova] Creating event network-changed:f711e7c2-6722-4058-8a3c-5703f7eafe86 for instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b on hv-cinder-78477 Apr 08 12:15:14.632410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-58ed187d-9bbb-493a-b3fb-23d5f888e656 req-50b43f66-649b-4f6a-84e1-c5b4dfe55a5c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049899 Apr 08 12:15:14.633261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 41/97] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:14.772390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:14.781484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e70b50f5-e8f1-4077-b44b-58dceae809c5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1516 microversion: 2.1 time: 0.361261 Apr 08 12:15:14.784144 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 57/98] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:14 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1516 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:14.801922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:14.803280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:14.812240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:14.812758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.813619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:14.814116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:14.879870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lazy-loading 'flavor' on Instance uuid 621d3032-5955-4802-8608-e77c44fb5846 {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:15:15.201022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-40ec4bfc-0bf3-4bc9-a620-2390f34a8382 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846/action" status: 200 len: 32 microversion: 2.1 time: 0.404270 Apr 08 12:15:15.205795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 42/99] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:14 2021] POST /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846/action => generated 32 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:15:15.211997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:15.212836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:15.227345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:15.228077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:15.233848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:15.233848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:15.435552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:15.436323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:15.451770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:15.462458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:15.463429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:15.463948 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:15.618126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:15.628009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a5dd2c37-86ef-4135-aeec-0b49a729c741 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.420566 Apr 08 12:15:15.628861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 58/100] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:15 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:15.642956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9022a7ab-0eb1-4932-8461-d81343aefc6c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:15.644442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9022a7ab-0eb1-4932-8461-d81343aefc6c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:15.653944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9022a7ab-0eb1-4932-8461-d81343aefc6c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:15.654586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9022a7ab-0eb1-4932-8461-d81343aefc6c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:15.656399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9022a7ab-0eb1-4932-8461-d81343aefc6c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:15.657183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9022a7ab-0eb1-4932-8461-d81343aefc6c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:15.841455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9022a7ab-0eb1-4932-8461-d81343aefc6c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 0.207087 Apr 08 12:15:15.845152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 59/101] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:15 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:15:16.198052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d0eafd1f-026d-44ec-a5b5-b93d2adca03f req-f67855fb-090b-48b9-989c-fc2a97fc050b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704586d7-ad35-414f-af0c-5835b542f260", "name": "network-vif-plugged", "status": "completed", "tag": "53f6e72e-034c-4c1c-be6e-8d0a69255cf0"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:16.200247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:16.200247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:16.213740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d0eafd1f-026d-44ec-a5b5-b93d2adca03f req-f67855fb-090b-48b9-989c-fc2a97fc050b service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:16.214244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d0eafd1f-026d-44ec-a5b5-b93d2adca03f req-f67855fb-090b-48b9-989c-fc2a97fc050b service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:16.232884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d0eafd1f-026d-44ec-a5b5-b93d2adca03f req-f67855fb-090b-48b9-989c-fc2a97fc050b service nova] Creating event network-vif-plugged:53f6e72e-034c-4c1c-be6e-8d0a69255cf0 for instance 704586d7-ad35-414f-af0c-5835b542f260 on hv-cinder-78477 Apr 08 12:15:16.239381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d0eafd1f-026d-44ec-a5b5-b93d2adca03f req-f67855fb-090b-48b9-989c-fc2a97fc050b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052587 Apr 08 12:15:16.241046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 60/102] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:15:16.506581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:16.515571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:16.517003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:16.518207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-af3f295e-9ed3-4aef-b82c-221ed0423abe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 1.087633 Apr 08 12:15:16.519445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 43/103] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:15 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:16.647445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:16.648219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:16.660122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:16.660663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:16.662156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:16.662730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:16.854215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d9008afb-1a3f-4cb5-a594-34960ac7a6e8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:16.855306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d9008afb-1a3f-4cb5-a594-34960ac7a6e8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:16.863989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d9008afb-1a3f-4cb5-a594-34960ac7a6e8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:16.864499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d9008afb-1a3f-4cb5-a594-34960ac7a6e8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:16.865353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d9008afb-1a3f-4cb5-a594-34960ac7a6e8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:16.865844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d9008afb-1a3f-4cb5-a594-34960ac7a6e8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:17.003251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d9008afb-1a3f-4cb5-a594-34960ac7a6e8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 0.153051 Apr 08 12:15:17.007707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 44/104] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:16 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 12:15:17.134959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:17.140542 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-75ffe461-9d37-43ef-adca-7f103c002a8b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.497786 Apr 08 12:15:17.141432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 61/105] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:16 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:17.540634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:17.541400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:17.549860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:17.550406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:17.551242 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:17.552358 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:17.752289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:17.762480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:17.764163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:17.765334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-92703912-317e-4519-ada8-26a474437d58 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.229811 Apr 08 12:15:17.765950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 45/106] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:17 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:18.018873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ab48c042-4fbb-4d9c-bfe6-5018446b043c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:18.021035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ab48c042-4fbb-4d9c-bfe6-5018446b043c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:18.031407 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab48c042-4fbb-4d9c-bfe6-5018446b043c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:18.031913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab48c042-4fbb-4d9c-bfe6-5018446b043c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:18.032757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab48c042-4fbb-4d9c-bfe6-5018446b043c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:18.033243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab48c042-4fbb-4d9c-bfe6-5018446b043c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:18.159353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:18.160205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:18.168480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:18.168983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:18.169823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:18.170335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:18.450928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:18.461753 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7851cbfc-a7d7-47b8-88b7-440aeb06a7c3 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.306365 Apr 08 12:15:18.462870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 46/107] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:18 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:18.784854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:18.785531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:18.794060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:18.794626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:18.795522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:18.796023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:19.000539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:19.010360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:19.012043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:19.013207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0dd6de8d-a350-4792-9f0e-3c2de193b721 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.232544 Apr 08 12:15:19.013979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 47/108] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:18 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:19.479970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:19.480770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:19.488621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:19.489426 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:19.490279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:19.490832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:19.702123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:19.711563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59238919-d116-4377-ae7e-2a4f46d3cd22 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.235699 Apr 08 12:15:19.712206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 48/109] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:19 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:20.033038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:20.035688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:20.041615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:20.042126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:20.043027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:20.043525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:20.264067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:20.280011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:20.288001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:20.288001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-13113bf8-1ef0-4bad-9c6e-9cce374e6c8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.254269 Apr 08 12:15:20.288001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 49/110] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:20 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:15:20.738943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:20.738943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:20.742533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:20.743262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:20.744344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:20.745033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:20.797744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ab48c042-4fbb-4d9c-bfe6-5018446b043c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 2.784975 Apr 08 12:15:20.798695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 62/111] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:18 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 2787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:15:20.993612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:21.002638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-95e20fbb-ff8c-438d-a46d-857e3adf385c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.274990 Apr 08 12:15:21.003273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 50/112] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:20 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:21.306945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:21.308323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:21.319043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:21.321191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:21.322247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:21.323036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:21.650991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:21.662169 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:21.663884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:21.670288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7211aef5-8924-4170-9d30-969cbc91807f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1406 microversion: 2.20 time: 0.363968 Apr 08 12:15:21.689696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 63/113] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:21 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:21.810562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-df441d82-03e2-4742-87d7-a3e409769e32 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:21.811600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-df441d82-03e2-4742-87d7-a3e409769e32 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:21.821816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df441d82-03e2-4742-87d7-a3e409769e32 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:21.822589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df441d82-03e2-4742-87d7-a3e409769e32 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:21.824674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df441d82-03e2-4742-87d7-a3e409769e32 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:21.824674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df441d82-03e2-4742-87d7-a3e409769e32 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:21.936333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-df441d82-03e2-4742-87d7-a3e409769e32 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 0.129817 Apr 08 12:15:21.937022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 51/114] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:21 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:15:22.021748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:22.022906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:22.033282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:22.050579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:22.052009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:22.052532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:22.298641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:22.307330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3953e650-b39a-459c-93ef-41807be43093 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.290430 Apr 08 12:15:22.307919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 64/115] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:22 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:22.694105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:22.695048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:22.703972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:22.704579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:22.705562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:22.706060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:22.950004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aa2131da-0168-47e7-83a5-24258701de88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:22.951061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aa2131da-0168-47e7-83a5-24258701de88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:22.964596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa2131da-0168-47e7-83a5-24258701de88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:22.965107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa2131da-0168-47e7-83a5-24258701de88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:22.965958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa2131da-0168-47e7-83a5-24258701de88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:22.966501 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa2131da-0168-47e7-83a5-24258701de88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:23.001954 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:23.012517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:23.014063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:23.015579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-854002b3-c14e-4758-a1c4-736ad5b9c618 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1598 microversion: 2.20 time: 0.327279 Apr 08 12:15:23.016171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 52/116] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:15:22 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1598 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:15:23.036671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cc20f5c3-467b-4776-9d00-8e03fd833c5b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:23.037340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cc20f5c3-467b-4776-9d00-8e03fd833c5b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:23.045234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc20f5c3-467b-4776-9d00-8e03fd833c5b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:23.045755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc20f5c3-467b-4776-9d00-8e03fd833c5b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:23.046742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc20f5c3-467b-4776-9d00-8e03fd833c5b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:23.047276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc20f5c3-467b-4776-9d00-8e03fd833c5b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:23.077867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aa2131da-0168-47e7-83a5-24258701de88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 0.133288 Apr 08 12:15:23.078776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 65/117] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:22 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:15:23.219475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cc20f5c3-467b-4776-9d00-8e03fd833c5b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.187461 Apr 08 12:15:23.220427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 53/118] 10.222.0.43 () {60 vars in 1306 bytes} [Thu Apr 8 12:15:23 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:15:23.326677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:23.327963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:23.338618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:23.339377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:23.340949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:23.341658 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:23.607353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:23.621460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b26bc3f4-466f-4775-b57f-dfdaf593a4b7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.299381 Apr 08 12:15:23.622580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 66/119] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:23 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:23.982672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-353786856", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "3ba216da-ab5f-4265-9387-3aaa52f8d07f"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:24.100316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a1e9ea21-412f-48e0-a4a7-f3790196c064 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:24.100316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a1e9ea21-412f-48e0-a4a7-f3790196c064 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:24.105413 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] validate_networks() for [('3ba216da-ab5f-4265-9387-3aaa52f8d07f', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:15:24.107829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1e9ea21-412f-48e0-a4a7-f3790196c064 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:24.108564 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1e9ea21-412f-48e0-a4a7-f3790196c064 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:24.109625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1e9ea21-412f-48e0-a4a7-f3790196c064 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:24.110328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1e9ea21-412f-48e0-a4a7-f3790196c064 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:24.287378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a1e9ea21-412f-48e0-a4a7-f3790196c064 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 0.200791 Apr 08 12:15:24.291402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 67/120] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:24 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:15:24.651564 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:24.652373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:24.662508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:24.663021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:24.663888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:24.664383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:24.993631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:25.007005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-51e7fc67-9acb-417f-8646-457a4f99ad02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.359963 Apr 08 12:15:25.008119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 68/121] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:24 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:25.299245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-053dd27c-5925-42c5-9bb9-d34648b83746 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:25.300338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-053dd27c-5925-42c5-9bb9-d34648b83746 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:25.309248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-053dd27c-5925-42c5-9bb9-d34648b83746 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:25.309956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-053dd27c-5925-42c5-9bb9-d34648b83746 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:25.310851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-053dd27c-5925-42c5-9bb9-d34648b83746 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:25.311340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-053dd27c-5925-42c5-9bb9-d34648b83746 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:25.458482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-053dd27c-5925-42c5-9bb9-d34648b83746 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 14 microversion: 2.1 time: 0.162284 Apr 08 12:15:25.461899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 69/122] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:25 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 12:15:25.496984 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:15:25.497907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:15:25.498568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:15:25.499153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:15:25.499910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:15:25.511247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:25.512535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:25.513621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:25.514363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:25.539635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:15:25.548612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for user 12ac1ec4656f4449ac95090c4a6c9b27 and project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:15:25.572449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:15:25.576347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:15:25.827830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-43bc0cd8-3c6a-468c-81af-4990ec10ec9a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.851058 Apr 08 12:15:25.835610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 54/123] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:15:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:15:25.841126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3491a8b2-0e07-448d-aea0-ca887b9f8685 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:25.842109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3491a8b2-0e07-448d-aea0-ca887b9f8685 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:25.969558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3491a8b2-0e07-448d-aea0-ca887b9f8685 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:26.005611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3491a8b2-0e07-448d-aea0-ca887b9f8685 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1217 microversion: 2.1 time: 0.168701 Apr 08 12:15:26.013646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 70/124] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:25 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:26.034271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:26.035023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:26.052246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:26.052953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:26.053991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:26.054879 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:26.095701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-77729a9b-714f-4e95-8169-a8b3cb1ea5ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:26.098676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-77729a9b-714f-4e95-8169-a8b3cb1ea5ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:26.106445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77729a9b-714f-4e95-8169-a8b3cb1ea5ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:26.107162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77729a9b-714f-4e95-8169-a8b3cb1ea5ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:26.108172 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77729a9b-714f-4e95-8169-a8b3cb1ea5ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:26.108787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-77729a9b-714f-4e95-8169-a8b3cb1ea5ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:26.292590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-77729a9b-714f-4e95-8169-a8b3cb1ea5ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.200786 Apr 08 12:15:26.294201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 71/125] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:26 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:26.299889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-04740d28-aa8a-452e-82d6-6fa446623805 req-5dfa31cd-b755-4f62-8e3b-c076fa19c5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704586d7-ad35-414f-af0c-5835b542f260", "tag": "53f6e72e-034c-4c1c-be6e-8d0a69255cf0"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:26.302338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:26.302338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:26.328512 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-04740d28-aa8a-452e-82d6-6fa446623805 req-5dfa31cd-b755-4f62-8e3b-c076fa19c5cb service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:26.333192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-04740d28-aa8a-452e-82d6-6fa446623805 req-5dfa31cd-b755-4f62-8e3b-c076fa19c5cb service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:26.370043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-04740d28-aa8a-452e-82d6-6fa446623805 req-5dfa31cd-b755-4f62-8e3b-c076fa19c5cb service nova] Creating event network-changed:53f6e72e-034c-4c1c-be6e-8d0a69255cf0 for instance 704586d7-ad35-414f-af0c-5835b542f260 on hv-cinder-78477 Apr 08 12:15:26.378573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-04740d28-aa8a-452e-82d6-6fa446623805 req-5dfa31cd-b755-4f62-8e3b-c076fa19c5cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082497 Apr 08 12:15:26.379579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 72/126] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:26.471386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-118f4d05-0ca3-42f3-8b44-2da0219b5042 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:26.474061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-118f4d05-0ca3-42f3-8b44-2da0219b5042 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:26.491300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118f4d05-0ca3-42f3-8b44-2da0219b5042 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:26.491895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118f4d05-0ca3-42f3-8b44-2da0219b5042 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:26.492976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118f4d05-0ca3-42f3-8b44-2da0219b5042 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:26.493651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118f4d05-0ca3-42f3-8b44-2da0219b5042 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:26.632256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-118f4d05-0ca3-42f3-8b44-2da0219b5042 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 6451 microversion: 2.1 time: 0.161632 Apr 08 12:15:26.632256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 73/127] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:26 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 6451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:26.702093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:26.704317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-060e3f6c-4cb7-4a25-872b-de53ad37db62 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.682623 Apr 08 12:15:26.705086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 55/128] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:26 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:27.027244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:27.028426 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:27.050168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.050728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.051706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.052152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.211174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:27.220433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4158336d-0e34-4839-ba45-4cabddd8cc4f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1213 microversion: 2.1 time: 0.199667 Apr 08 12:15:27.222361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 74/129] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:27 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:27.306777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ac14b014-d8cd-46e9-a98e-625e3e7e4055 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:27.308160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ac14b014-d8cd-46e9-a98e-625e3e7e4055 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:27.335046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac14b014-d8cd-46e9-a98e-625e3e7e4055 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.338460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac14b014-d8cd-46e9-a98e-625e3e7e4055 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.339817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac14b014-d8cd-46e9-a98e-625e3e7e4055 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.341579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac14b014-d8cd-46e9-a98e-625e3e7e4055 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.602817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ac14b014-d8cd-46e9-a98e-625e3e7e4055 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.300084 Apr 08 12:15:27.603670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 56/130] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:27 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:27.642295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e61eebbc-1f56-43aa-92b8-6b89092d47e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:27.643333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e61eebbc-1f56-43aa-92b8-6b89092d47e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:27.670113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61eebbc-1f56-43aa-92b8-6b89092d47e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.670660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61eebbc-1f56-43aa-92b8-6b89092d47e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.671527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61eebbc-1f56-43aa-92b8-6b89092d47e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.672034 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e61eebbc-1f56-43aa-92b8-6b89092d47e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.723773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:27.724761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:27.752736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.753458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.755176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:27.767089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:27.836694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e61eebbc-1f56-43aa-92b8-6b89092d47e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 10009 microversion: 2.1 time: 0.198811 Apr 08 12:15:27.837302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 75/131] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:27 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 10009 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:28.242837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:28.244126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:28.264561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:28.265235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:28.270009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:28.274990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:28.457667 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:28.475630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-81c2ecb2-10a1-4a3f-8105-5a58a3d7b881 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.756288 Apr 08 12:15:28.477827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 57/132] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:27 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:28.587945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:28.602452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-db46b408-2b0f-4ae6-8f2e-23fdbb3c35b2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1277 microversion: 2.1 time: 0.364388 Apr 08 12:15:28.604536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 76/133] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:28 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1277 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:28.620103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8d8c02bb-bd85-4499-9025-3b927d00b3af tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:28.620103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8d8c02bb-bd85-4499-9025-3b927d00b3af tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:28.659489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d8c02bb-bd85-4499-9025-3b927d00b3af tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:28.660012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d8c02bb-bd85-4499-9025-3b927d00b3af tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:28.661722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d8c02bb-bd85-4499-9025-3b927d00b3af tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:28.674560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d8c02bb-bd85-4499-9025-3b927d00b3af tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:28.854175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dc94e5ae-abde-4a1e-9329-b2c6cb1688a3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:28.854175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dc94e5ae-abde-4a1e-9329-b2c6cb1688a3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:28.870004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc94e5ae-abde-4a1e-9329-b2c6cb1688a3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:28.874062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc94e5ae-abde-4a1e-9329-b2c6cb1688a3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:28.875012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc94e5ae-abde-4a1e-9329-b2c6cb1688a3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:28.875514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc94e5ae-abde-4a1e-9329-b2c6cb1688a3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:28.974259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8d8c02bb-bd85-4499-9025-3b927d00b3af tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.362328 Apr 08 12:15:28.974999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 58/134] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:28 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:29.097403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dc94e5ae-abde-4a1e-9329-b2c6cb1688a3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 15025 microversion: 2.1 time: 0.252962 Apr 08 12:15:29.098883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 77/135] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:28 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 15025 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:29.495661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:29.497023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:29.517651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:29.518386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:29.519566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:29.520750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:29.628607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:29.633120 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:29.638464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:29.638984 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:29.640065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:29.640562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:29.939378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:29.951471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cc74c1e4-d7ed-40e7-a558-643d0a91b77a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1275 microversion: 2.1 time: 0.326696 Apr 08 12:15:29.954270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 78/136] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:29 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1275 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:29.995318 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-98d64d04-c99d-47f0-b030-f4ea8a350679 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:29.998588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-98d64d04-c99d-47f0-b030-f4ea8a350679 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:30.014087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d64d04-c99d-47f0-b030-f4ea8a350679 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:30.014631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d64d04-c99d-47f0-b030-f4ea8a350679 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:30.021073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d64d04-c99d-47f0-b030-f4ea8a350679 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:30.021993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98d64d04-c99d-47f0-b030-f4ea8a350679 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:30.033516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:30.064891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-faef5695-daee-45ab-ab89-93b9c6ee84dd tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.575123 Apr 08 12:15:30.067855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 59/137] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:29 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:30.111451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8e3ce3c0-4f02-4b26-82d1-84a9e2162cd1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:30.112807 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8e3ce3c0-4f02-4b26-82d1-84a9e2162cd1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:30.133939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3ce3c0-4f02-4b26-82d1-84a9e2162cd1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:30.138844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3ce3c0-4f02-4b26-82d1-84a9e2162cd1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:30.139981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3ce3c0-4f02-4b26-82d1-84a9e2162cd1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:30.140659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3ce3c0-4f02-4b26-82d1-84a9e2162cd1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:30.208553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-98d64d04-c99d-47f0-b030-f4ea8a350679 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.217968 Apr 08 12:15:30.209673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 79/138] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:29 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:30.300282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8e3ce3c0-4f02-4b26-82d1-84a9e2162cd1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 17226 microversion: 2.1 time: 0.192614 Apr 08 12:15:30.301645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 60/139] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:30 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 17226 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:15:30.975894 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:30.976620 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:30.985706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:30.986321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:30.998969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:30.999491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.087211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:31.088102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:31.097166 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.097846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.099009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.099599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.365274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:31.373411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-de9fe66f-ea04-45a1-accf-bf818a785e97 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.292584 Apr 08 12:15:31.374035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 61/140] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:31 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:31.379402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5bb2c41e-9b9d-4890-9247-9e4833318689 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:31.380404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5bb2c41e-9b9d-4890-9247-9e4833318689 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:31.388393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5bb2c41e-9b9d-4890-9247-9e4833318689 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.389079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5bb2c41e-9b9d-4890-9247-9e4833318689 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.390072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5bb2c41e-9b9d-4890-9247-9e4833318689 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.390775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5bb2c41e-9b9d-4890-9247-9e4833318689 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.500449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5bb2c41e-9b9d-4890-9247-9e4833318689 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.124979 Apr 08 12:15:31.504538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 62/141] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:31 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:31.514116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e31fd0ea-8cc8-42f0-bfef-222b08d7fab0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:31.515275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e31fd0ea-8cc8-42f0-bfef-222b08d7fab0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:31.524323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e31fd0ea-8cc8-42f0-bfef-222b08d7fab0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.524791 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e31fd0ea-8cc8-42f0-bfef-222b08d7fab0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.525628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e31fd0ea-8cc8-42f0-bfef-222b08d7fab0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.526110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e31fd0ea-8cc8-42f0-bfef-222b08d7fab0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.684180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:31.693796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-455dc5e8-4c18-4457-9c61-c27bc73e2ff7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.722928 Apr 08 12:15:31.694483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 80/142] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:30 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:31.700680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:31.700982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:31.713267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.713267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.713267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:31.713267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:31.782982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:15:32.023415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-871378b0-e27e-43c9-87a4-443268f661ad tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 204 len: 0 microversion: 2.1 time: 0.326769 Apr 08 12:15:32.024082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 81/143] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:15:31 2021] DELETE /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:15:32.032719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:32.033481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:32.042156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:32.042700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:32.043535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:32.044023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:32.401887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:32.411598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-44386b90-07ec-494d-a417-65dbe0212ac2 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1554 microversion: 2.1 time: 0.383048 Apr 08 12:15:32.412208 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 82/144] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:32 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1554 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:32.417612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-1bc7ef14-0eb4-4f60-b7e6-60a4a4746d1c req-c937d3ce-3456-4139-b249-9912ef2238a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb", "tag": "5a94a06b-3cc9-4eb2-b8aa-2a61327d0119"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:32.419495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:32.419495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:32.428646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1bc7ef14-0eb4-4f60-b7e6-60a4a4746d1c req-c937d3ce-3456-4139-b249-9912ef2238a4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:32.429142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1bc7ef14-0eb4-4f60-b7e6-60a4a4746d1c req-c937d3ce-3456-4139-b249-9912ef2238a4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:32.449630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-1bc7ef14-0eb4-4f60-b7e6-60a4a4746d1c req-c937d3ce-3456-4139-b249-9912ef2238a4 service nova] Creating event network-changed:5a94a06b-3cc9-4eb2-b8aa-2a61327d0119 for instance 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb on hv-cinder-78477 Apr 08 12:15:32.454580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-1bc7ef14-0eb4-4f60-b7e6-60a4a4746d1c req-c937d3ce-3456-4139-b249-9912ef2238a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040902 Apr 08 12:15:32.455216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 83/145] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:32.461096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:32.461856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:32.469474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:32.469979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:32.470838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:32.471326 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:32.663581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:32.672553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59695493-dab6-445e-8e84-5159eb2a5a7d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.216171 Apr 08 12:15:32.673174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 84/146] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:32 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:32.678766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6c09dddd-81ce-4ebf-84b3-8b484a496d3e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:32.679871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6c09dddd-81ce-4ebf-84b3-8b484a496d3e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:32.687490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c09dddd-81ce-4ebf-84b3-8b484a496d3e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:32.688051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c09dddd-81ce-4ebf-84b3-8b484a496d3e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:32.688882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c09dddd-81ce-4ebf-84b3-8b484a496d3e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:32.689375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c09dddd-81ce-4ebf-84b3-8b484a496d3e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:33.677047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e31fd0ea-8cc8-42f0-bfef-222b08d7fab0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 18777 microversion: 2.1 time: 2.173304 Apr 08 12:15:33.677547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 63/147] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:31 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 18777 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:33.683087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:33.683847 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:33.693186 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:33.693688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:33.694560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:33.695093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:33.890040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:33.898901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cd492abe-3b58-4aee-ad8f-8c4380c1d011 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.220112 Apr 08 12:15:33.899513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 64/148] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:33 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:33.904105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:33.904757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:33.912592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:33.913102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:33.913933 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:33.914449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:34.109731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:34.120097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-240fa14f-9197-49c4-9208-74730c10fb0b tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1554 microversion: 2.1 time: 0.219547 Apr 08 12:15:34.120722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 65/149] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:33 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:34.125719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:34.126405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:34.134004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:34.134548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:34.135384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:34.135879 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:34.330453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:34.339779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ecbef359-dc03-4abf-abec-4fc7daf4e899 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.218039 Apr 08 12:15:34.340388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 66/150] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:34 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:34.688430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-01c6b210-2ce8-41e7-adc7-5d2e4f9175b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:34.689537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-01c6b210-2ce8-41e7-adc7-5d2e4f9175b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:34.697909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c6b210-2ce8-41e7-adc7-5d2e4f9175b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:34.698452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c6b210-2ce8-41e7-adc7-5d2e4f9175b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:34.699297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c6b210-2ce8-41e7-adc7-5d2e4f9175b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:34.699798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01c6b210-2ce8-41e7-adc7-5d2e4f9175b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:34.962202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6c09dddd-81ce-4ebf-84b3-8b484a496d3e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 2.287610 Apr 08 12:15:34.963055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-01c6b210-2ce8-41e7-adc7-5d2e4f9175b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 21938 microversion: 2.1 time: 0.277983 Apr 08 12:15:34.963480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 85/151] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:32 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:34.964150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 67/152] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:34 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 21938 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:15:34.970922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:34.971781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:34.981228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:34.981949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:34.982887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:34.983635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.139770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:35.140542 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:35.149931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.150473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.151324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.151797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.382481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:35.400148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-78a2d78d-0922-43e8-828c-d813e7c83812 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1554 microversion: 2.1 time: 0.264806 Apr 08 12:15:35.411307 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 68/153] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:35 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1554 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:35.426045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:35.426771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:35.434966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.435533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.436350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.436849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.539656 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:35.548688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-067066f0-423f-4049-9ee6-19557530757c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.583006 Apr 08 12:15:35.549664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 86/154] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:34 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:35.661983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:35.671291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cb5c5fc9-b7d1-49c1-a86a-0534ad8fb28c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.249317 Apr 08 12:15:35.672433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 69/155] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:35 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:35.973902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-567d9ac3-5166-4cae-ab1f-4a200e88d383 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:35.974946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-567d9ac3-5166-4cae-ab1f-4a200e88d383 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:35.975077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f8c26be9-cd5f-4b2f-84b7-915abe746054 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:35.976004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f8c26be9-cd5f-4b2f-84b7-915abe746054 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:35.983424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-567d9ac3-5166-4cae-ab1f-4a200e88d383 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.984117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8c26be9-cd5f-4b2f-84b7-915abe746054 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.984229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-567d9ac3-5166-4cae-ab1f-4a200e88d383 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.984409 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8c26be9-cd5f-4b2f-84b7-915abe746054 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.984852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-567d9ac3-5166-4cae-ab1f-4a200e88d383 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.985201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8c26be9-cd5f-4b2f-84b7-915abe746054 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:35.985405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-567d9ac3-5166-4cae-ab1f-4a200e88d383 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:35.985701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8c26be9-cd5f-4b2f-84b7-915abe746054 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:36.130813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f8c26be9-cd5f-4b2f-84b7-915abe746054 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 22964 microversion: 2.1 time: 0.159478 Apr 08 12:15:36.134888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 70/156] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:35 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 22964 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:36.154802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-567d9ac3-5166-4cae-ab1f-4a200e88d383 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.184880 Apr 08 12:15:36.155602 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 87/157] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:35 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:36.430193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:36.431120 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:36.441117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:36.441678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:36.443104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:36.443608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:36.568369 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:36.569125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:36.577636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:36.578571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:36.579432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:36.579899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:36.652833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:36.664022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fba57cae-5d3f-47ec-8732-3da21d8f9994 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1554 microversion: 2.1 time: 0.239512 Apr 08 12:15:36.664835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 71/158] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:36 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:36.689265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:36.690017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:36.699087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:36.699592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:36.700471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:36.700962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:36.802850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:36.819774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-436836a0-e50d-4d76-b1b5-ec7ad15c317e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.256508 Apr 08 12:15:36.820537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 88/159] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:36 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:36.971273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:36.980349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7cb44403-65a2-4cec-a62a-533360f0a453 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.295132 Apr 08 12:15:36.980959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 72/160] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:36 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:37.143130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-20fdcd14-6b54-488e-94a4-7287adf9e6b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:37.144207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-20fdcd14-6b54-488e-94a4-7287adf9e6b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:37.153185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20fdcd14-6b54-488e-94a4-7287adf9e6b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:37.153654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20fdcd14-6b54-488e-94a4-7287adf9e6b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:37.154522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20fdcd14-6b54-488e-94a4-7287adf9e6b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:37.155016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20fdcd14-6b54-488e-94a4-7287adf9e6b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:37.165932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2fb66fb1-f08b-41dc-8c04-126c5db54091 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:37.167558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2fb66fb1-f08b-41dc-8c04-126c5db54091 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:37.177847 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fb66fb1-f08b-41dc-8c04-126c5db54091 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:37.178359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fb66fb1-f08b-41dc-8c04-126c5db54091 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:37.179409 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fb66fb1-f08b-41dc-8c04-126c5db54091 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:37.180024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fb66fb1-f08b-41dc-8c04-126c5db54091 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:39.472325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-20fdcd14-6b54-488e-94a4-7287adf9e6b0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 24428 microversion: 2.1 time: 2.332942 Apr 08 12:15:39.474523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 89/161] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:37 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 24428 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:39.479956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:39.480747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:39.482283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2fb66fb1-f08b-41dc-8c04-126c5db54091 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 2.320435 Apr 08 12:15:39.483038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 73/162] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:37 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:39.489268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:39.489557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:39.490039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:39.490143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:39.496212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:39.496212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:39.498947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:39.499464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:39.500324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:39.500840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:39.716739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:39.727427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-205102fc-df62-41fb-bdf4-153def9d52a1 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1554 microversion: 2.1 time: 0.251858 Apr 08 12:15:39.727853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 90/163] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:39 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1554 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:39.731164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:39.734934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:39.735624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:39.741515 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e15f42d9-8c95-4cd5-83f7-04b2541c50b7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.256903 Apr 08 12:15:39.742151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 74/164] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:39 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:39.743819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:39.744341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:39.745195 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:39.745686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:39.948531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:39.958204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4dd8087b-9bf3-4736-8459-670fb4d5f715 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.228175 Apr 08 12:15:39.958907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 91/165] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:39 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:40.485794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-35d69ddc-7835-4bb8-ba73-badd8ac741ea tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:40.486956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-35d69ddc-7835-4bb8-ba73-badd8ac741ea tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:40.493960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-52aa0717-39a2-4533-9775-8faa8148b681 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:40.495415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-52aa0717-39a2-4533-9775-8faa8148b681 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:40.495977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35d69ddc-7835-4bb8-ba73-badd8ac741ea tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.496491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35d69ddc-7835-4bb8-ba73-badd8ac741ea tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.497341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35d69ddc-7835-4bb8-ba73-badd8ac741ea tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.498090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35d69ddc-7835-4bb8-ba73-badd8ac741ea tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.504060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-52aa0717-39a2-4533-9775-8faa8148b681 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.505322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-52aa0717-39a2-4533-9775-8faa8148b681 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.506217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-52aa0717-39a2-4533-9775-8faa8148b681 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.506734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-52aa0717-39a2-4533-9775-8faa8148b681 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.641060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-35d69ddc-7835-4bb8-ba73-badd8ac741ea tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 25127 microversion: 2.1 time: 0.159300 Apr 08 12:15:40.641767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 75/166] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:40 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 25127 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:40.645065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-52aa0717-39a2-4533-9775-8faa8148b681 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.154738 Apr 08 12:15:40.646155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 92/167] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:40 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:40.746821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:40.752770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:40.756567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.757030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.757881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.758393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.760465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:40.761240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:40.770119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.770767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.771609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.772104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.964351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:40.975224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9f137728-3780-4736-815b-55b2a55b5e26 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1554 microversion: 2.1 time: 0.233067 Apr 08 12:15:40.975855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 76/168] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:40 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:40.980526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:40.981179 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:40.989308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.989823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:40.990699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:40.991190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:41.112930 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:41.122347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2ade171f-afe4-4a2f-898b-0c8781ac51bd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.366478 Apr 08 12:15:41.124006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 93/169] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:40 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:41.197440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:41.206509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7dbd8221-ac6c-4ccf-addb-e62970360af8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.229576 Apr 08 12:15:41.207184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 77/170] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:40 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:41.653891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8cdec69a-8817-4127-9e6b-0b21d4e1aae1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:41.654912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8cdec69a-8817-4127-9e6b-0b21d4e1aae1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:41.657340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a77e8589-7f8d-42d4-b3b6-fbdb24ad5605 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:41.658644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a77e8589-7f8d-42d4-b3b6-fbdb24ad5605 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:41.663653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8cdec69a-8817-4127-9e6b-0b21d4e1aae1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:41.664160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8cdec69a-8817-4127-9e6b-0b21d4e1aae1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:41.665002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8cdec69a-8817-4127-9e6b-0b21d4e1aae1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:41.665491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8cdec69a-8817-4127-9e6b-0b21d4e1aae1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:41.668713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a77e8589-7f8d-42d4-b3b6-fbdb24ad5605 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:41.669228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a77e8589-7f8d-42d4-b3b6-fbdb24ad5605 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:41.670056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a77e8589-7f8d-42d4-b3b6-fbdb24ad5605 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:41.670721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a77e8589-7f8d-42d4-b3b6-fbdb24ad5605 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:41.840846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8cdec69a-8817-4127-9e6b-0b21d4e1aae1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 25857 microversion: 2.1 time: 0.190876 Apr 08 12:15:41.841635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 94/171] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:41 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 25857 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:41.847104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a77e8589-7f8d-42d4-b3b6-fbdb24ad5605 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 14 microversion: 2.20 time: 0.193457 Apr 08 12:15:41.851077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 78/172] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:41 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:41.998218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:41.999030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:42.010127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.010661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.011507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.011995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.142226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:42.143029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:42.152402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.152923 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.153765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.154260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.198547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:42.211137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c67b529f-55b1-4144-8a9b-a2c6387431d7 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1512 microversion: 2.1 time: 0.221102 Apr 08 12:15:42.212092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 95/173] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:41 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:42.217480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-e454b6a5-7915-43b2-9ab4-4a46b9b290e1 req-d215d26d-9aad-4845-b0d1-ae2b13e338c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02abb1a-c178-42da-8900-5f7177a6c913", "name": "network-vif-deleted", "tag": "b7f3ab3c-e833-4264-9ab9-8b7ea6034a56"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:42.219778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:42.219778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:42.229735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e454b6a5-7915-43b2-9ab4-4a46b9b290e1 req-d215d26d-9aad-4845-b0d1-ae2b13e338c0 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.230550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e454b6a5-7915-43b2-9ab4-4a46b9b290e1 req-d215d26d-9aad-4845-b0d1-ae2b13e338c0 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.250456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-e454b6a5-7915-43b2-9ab4-4a46b9b290e1 req-d215d26d-9aad-4845-b0d1-ae2b13e338c0 service nova] Creating event network-vif-deleted:b7f3ab3c-e833-4264-9ab9-8b7ea6034a56 for instance f02abb1a-c178-42da-8900-5f7177a6c913 on hv-cinder-78477 Apr 08 12:15:42.260069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-e454b6a5-7915-43b2-9ab4-4a46b9b290e1 req-d215d26d-9aad-4845-b0d1-ae2b13e338c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046149 Apr 08 12:15:42.278508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 96/174] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:42.286625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:42.287842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:42.311024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.311024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.311024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.311024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.385484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:42.395958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-74438043-7f55-4504-905a-e9dda892d1b4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.258217 Apr 08 12:15:42.406082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 79/175] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:42 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:42.570783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:42.580312 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-677a06e3-d307-4bd6-91b8-b3d800a2c993 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.299153 Apr 08 12:15:42.583631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 97/176] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:42 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:42.853379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e038701f-3c60-4da3-8848-8652076d1dd3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:42.854554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e038701f-3c60-4da3-8848-8652076d1dd3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:42.859346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-892c71ae-b2e6-441e-b743-4e83d91c67eb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:42.860547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-892c71ae-b2e6-441e-b743-4e83d91c67eb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:42.862666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e038701f-3c60-4da3-8848-8652076d1dd3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.863081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e038701f-3c60-4da3-8848-8652076d1dd3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.863908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e038701f-3c60-4da3-8848-8652076d1dd3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.864409 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e038701f-3c60-4da3-8848-8652076d1dd3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.868694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-892c71ae-b2e6-441e-b743-4e83d91c67eb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.872052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-892c71ae-b2e6-441e-b743-4e83d91c67eb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.872052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-892c71ae-b2e6-441e-b743-4e83d91c67eb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:42.872052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-892c71ae-b2e6-441e-b743-4e83d91c67eb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:42.991403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e038701f-3c60-4da3-8848-8652076d1dd3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 26519 microversion: 2.1 time: 0.141586 Apr 08 12:15:42.991951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 80/177] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:42 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 26519 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:43.005053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-892c71ae-b2e6-441e-b743-4e83d91c67eb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 6257 microversion: 2.20 time: 0.148992 Apr 08 12:15:43.007425 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 98/178] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:42 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 6257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:15:43.230693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:43.231471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:43.240223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:43.240736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:43.241795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:43.242270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:43.316974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:43.317483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:43.317995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lazy-loading 'fault' on Instance uuid f02abb1a-c178-42da-8900-5f7177a6c913 {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:15:43.382807 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce0cd892246421dac6d1cf8f9d186df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d12229b5ee54bd8b6d2f1758187d5c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:43.393561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d4a69c74-5663-4826-8c82-a6c6fc4b6310 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 200 len: 1350 microversion: 2.1 time: 0.167360 Apr 08 12:15:43.394334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 81/179] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:43 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:43.415270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:43.416170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:43.427392 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:43.427905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:43.428901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:43.429396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:43.598958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:43.599694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:43.607756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:43.608277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:43.609130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:43.609635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:43.648984 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:43.658671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-46af0979-4956-4be8-a640-e7c8f559c9a2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.248927 Apr 08 12:15:43.659627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 99/180] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:43 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:43.819036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:43.827886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1ec36905-6778-4b55-9ed0-4fd2594be804 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.233417 Apr 08 12:15:43.828502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 82/181] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:43 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:44.003860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6f0bc479-b031-43b1-8efa-0790c8712e10 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:44.006098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6f0bc479-b031-43b1-8efa-0790c8712e10 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:44.014267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f0bc479-b031-43b1-8efa-0790c8712e10 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.014823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f0bc479-b031-43b1-8efa-0790c8712e10 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.015665 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f0bc479-b031-43b1-8efa-0790c8712e10 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.016231 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f0bc479-b031-43b1-8efa-0790c8712e10 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.017049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-60ddf1f5-dcc0-4071-9f1e-934625445cd9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:44.018385 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-60ddf1f5-dcc0-4071-9f1e-934625445cd9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:44.026789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60ddf1f5-dcc0-4071-9f1e-934625445cd9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.027247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60ddf1f5-dcc0-4071-9f1e-934625445cd9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.028340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60ddf1f5-dcc0-4071-9f1e-934625445cd9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.028838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60ddf1f5-dcc0-4071-9f1e-934625445cd9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.142601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6f0bc479-b031-43b1-8efa-0790c8712e10 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 27040 microversion: 2.1 time: 0.142480 Apr 08 12:15:44.143357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 100/182] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:43 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 27040 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:15:44.148891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-60ddf1f5-dcc0-4071-9f1e-934625445cd9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 10080 microversion: 2.20 time: 0.136361 Apr 08 12:15:44.150517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 83/183] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:44 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 10080 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:15:44.150630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-a576c1fb-5ee3-4c77-964b-a42e84e5148b req-61f62659-57b1-4066-adcc-adc2a1e55d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb", "name": "network-vif-plugged", "status": "completed", "tag": "5a94a06b-3cc9-4eb2-b8aa-2a61327d0119"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:44.151507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:15:44.151507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:15:44.161319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a576c1fb-5ee3-4c77-964b-a42e84e5148b req-61f62659-57b1-4066-adcc-adc2a1e55d23 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.161815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a576c1fb-5ee3-4c77-964b-a42e84e5148b req-61f62659-57b1-4066-adcc-adc2a1e55d23 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.179896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-a576c1fb-5ee3-4c77-964b-a42e84e5148b req-61f62659-57b1-4066-adcc-adc2a1e55d23 service nova] Creating event network-vif-plugged:5a94a06b-3cc9-4eb2-b8aa-2a61327d0119 for instance 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb on hv-cinder-78477 Apr 08 12:15:44.190234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-a576c1fb-5ee3-4c77-964b-a42e84e5148b req-61f62659-57b1-4066-adcc-adc2a1e55d23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041759 Apr 08 12:15:44.190234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 101/184] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:15:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:15:44.413924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:44.414965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:44.423808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.424361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.425210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.425785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.483800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] HTTP exception thrown: Instance f02abb1a-c178-42da-8900-5f7177a6c913 could not be found. Apr 08 12:15:44.484503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Returning 404 to user: Instance f02abb1a-c178-42da-8900-5f7177a6c913 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:15:44.485543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-37f21ca3-3a0a-45e3-80ca-4d956cee60b9 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 404 len: 111 microversion: 2.1 time: 0.076869 Apr 08 12:15:44.486196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 84/185] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:44 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:15:44.681739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:44.682551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:44.690657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.691168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.692868 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.693371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.845445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:44.846124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:44.855269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.855562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.856403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:44.856905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:44.904526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:44.914358 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b596a1c6-4cf4-4f8c-a9ce-0a57a3b39dff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.237512 Apr 08 12:15:44.915234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 102/186] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:44 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:45.060900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:45.071455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-efc7f129-955c-4866-9e48-d8e58b73d369 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.230147 Apr 08 12:15:45.072070 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 85/187] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:44 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:45.154321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b0326ea-ca13-4fdf-9d9e-82cd6653f981 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:45.155370 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9b0326ea-ca13-4fdf-9d9e-82cd6653f981 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:45.161038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e340ef79-ccd4-4b3a-9641-9f4c3990e820 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:45.162066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e340ef79-ccd4-4b3a-9641-9f4c3990e820 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:45.164084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-ca13-4fdf-9d9e-82cd6653f981 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:45.164640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-ca13-4fdf-9d9e-82cd6653f981 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:45.168464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-ca13-4fdf-9d9e-82cd6653f981 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:45.168464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-ca13-4fdf-9d9e-82cd6653f981 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:45.170002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e340ef79-ccd4-4b3a-9641-9f4c3990e820 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:45.170588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e340ef79-ccd4-4b3a-9641-9f4c3990e820 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:45.171423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e340ef79-ccd4-4b3a-9641-9f4c3990e820 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:45.171911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e340ef79-ccd4-4b3a-9641-9f4c3990e820 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:48.377766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9b0326ea-ca13-4fdf-9d9e-82cd6653f981 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 27771 microversion: 2.1 time: 3.227341 Apr 08 12:15:48.379942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 103/188] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:45 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 27771 bytes in 3231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:48.382746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e340ef79-ccd4-4b3a-9641-9f4c3990e820 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 19342 microversion: 2.20 time: 3.225815 Apr 08 12:15:48.387236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:48.387236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:48.388108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 86/189] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:45 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 19342 bytes in 3232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:15:48.395050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:48.396084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:48.396963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:48.397476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:48.398459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:48.398959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:48.406510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:48.407266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:48.408542 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:48.409313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:48.614542 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:48.617506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:48.623841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-67664bfa-2cb2-427a-b495-67679f563349 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1317 microversion: 2.1 time: 0.242663 Apr 08 12:15:48.624471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 104/190] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:48 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:48.626914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-255be71b-7f0d-4611-ab21-618814358d7c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.237291 Apr 08 12:15:48.627613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 87/191] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:48 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:49.392298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-118ee8f4-e9b6-4c64-a60c-187e6bbc0d81 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:49.394005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-118ee8f4-e9b6-4c64-a60c-187e6bbc0d81 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:49.397844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ab0ca131-5f4d-4b2e-8012-e4a4c867698f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:49.398869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ab0ca131-5f4d-4b2e-8012-e4a4c867698f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:49.404334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118ee8f4-e9b6-4c64-a60c-187e6bbc0d81 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.405262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118ee8f4-e9b6-4c64-a60c-187e6bbc0d81 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.406498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118ee8f4-e9b6-4c64-a60c-187e6bbc0d81 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.407185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118ee8f4-e9b6-4c64-a60c-187e6bbc0d81 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.407920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab0ca131-5f4d-4b2e-8012-e4a4c867698f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.408424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab0ca131-5f4d-4b2e-8012-e4a4c867698f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.409269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab0ca131-5f4d-4b2e-8012-e4a4c867698f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.409758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab0ca131-5f4d-4b2e-8012-e4a4c867698f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.544923 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-118ee8f4-e9b6-4c64-a60c-187e6bbc0d81 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28129 microversion: 2.1 time: 0.156731 Apr 08 12:15:49.546215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 105/192] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:49 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28129 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:49.548024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ab0ca131-5f4d-4b2e-8012-e4a4c867698f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 20832 microversion: 2.20 time: 0.155611 Apr 08 12:15:49.548586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 88/193] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:49 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 20832 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:15:49.551257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:49.551914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:49.560301 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.560822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.561664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.562160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.617531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] HTTP exception thrown: Instance f02abb1a-c178-42da-8900-5f7177a6c913 could not be found. Apr 08 12:15:49.618219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Returning 404 to user: Instance f02abb1a-c178-42da-8900-5f7177a6c913 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:15:49.619150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-742dcfa5-be4c-4df4-93ec-bbfe62196002 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 404 len: 111 microversion: 2.1 time: 0.072394 Apr 08 12:15:49.619757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 106/194] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:15:49 2021] DELETE /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:15:49.635075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:49.635851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] [instance: f02abb1a-c178-42da-8900-5f7177a6c913] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:49.645395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.645920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.649683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:49.649789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.649789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.649928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:49.656515 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.657111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.658065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.658666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.718670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] HTTP exception thrown: Instance f02abb1a-c178-42da-8900-5f7177a6c913 could not be found. Apr 08 12:15:49.719355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] Returning 404 to user: Instance f02abb1a-c178-42da-8900-5f7177a6c913 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:15:49.720265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0f70f8b3-953c-4dbc-8f28-560e2fea6aa0 tempest-DeleteServersTestJSON-218764522 tempest-DeleteServersTestJSON-218764522-project] 10.222.0.43 "GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913" status: 404 len: 111 microversion: 2.1 time: 0.089901 Apr 08 12:15:49.724458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 89/195] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:49 2021] GET /compute/v2.1/servers/f02abb1a-c178-42da-8900-5f7177a6c913 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:15:49.728432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:49.729220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:49.737696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.738465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.740156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:49.740156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:49.939797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:49.949416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e5484382-67ca-46cd-9d55-c60653507e9e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.227201 Apr 08 12:15:49.950045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 90/196] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:49 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:50.014693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:50.023729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6d0d6bc1-4804-40b5-b77d-72131dcae466 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1508 microversion: 2.1 time: 0.385391 Apr 08 12:15:50.024354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 107/197] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:49 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:15:50.041814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6efb2dec-2eb7-4786-bfaf-622c3f8b780c"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:50.043243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:50.052156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.052678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.053530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.054032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.237475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] HTTP exception thrown: Invalid volume: volume 6efb2dec-2eb7-4786-bfaf-622c3f8b780c is already attached to instances: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a Apr 08 12:15:50.238736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Returning 400 to user: Invalid volume: volume 6efb2dec-2eb7-4786-bfaf-622c3f8b780c is already attached to instances: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:15:50.239897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-60eae4ec-2be9-46f7-9273-bcc7eb036fdd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.202516 Apr 08 12:15:50.240561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 91/198] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:15:50 2021] POST /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb/os-volume_attachments => generated 174 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 12:15:50.357936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:50.361936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:50.371009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.371517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.372358 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.373097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.561259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f4eae842-f987-4a53-acf4-0afac45f6ead tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:50.564051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f4eae842-f987-4a53-acf4-0afac45f6ead tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:50.579193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4eae842-f987-4a53-acf4-0afac45f6ead tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.582873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lazy-loading 'services' on Instance uuid c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:15:50.590943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4eae842-f987-4a53-acf4-0afac45f6ead tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.594532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4eae842-f987-4a53-acf4-0afac45f6ead tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.594532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4eae842-f987-4a53-acf4-0afac45f6ead tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.746007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f4eae842-f987-4a53-acf4-0afac45f6ead tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28129 microversion: 2.1 time: 0.189025 Apr 08 12:15:50.746972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 92/199] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:50 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28129 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:50.758481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-69e9e76a-ad80-480c-b309-c6b6a85c64db tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:50.759848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-69e9e76a-ad80-480c-b309-c6b6a85c64db tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:50.768302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69e9e76a-ad80-480c-b309-c6b6a85c64db tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.768811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69e9e76a-ad80-480c-b309-c6b6a85c64db tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.770739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69e9e76a-ad80-480c-b309-c6b6a85c64db tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.771250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69e9e76a-ad80-480c-b309-c6b6a85c64db tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.897855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-69e9e76a-ad80-480c-b309-c6b6a85c64db tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 22538 microversion: 2.20 time: 0.146003 Apr 08 12:15:50.897855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 93/200] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:50 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 22538 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:15:50.903600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6406ccb1-4142-4b9a-956d-54e37b5c282d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a/os-volume_attachments/6efb2dec-2eb7-4786-bfaf-622c3f8b780c" status: 202 len: 0 microversion: 2.1 time: 0.549660 Apr 08 12:15:50.904245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 108/201] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:15:50 2021] DELETE /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a/os-volume_attachments/6efb2dec-2eb7-4786-bfaf-622c3f8b780c => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:15:50.972246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:50.974151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:50.984282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.984944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:50.986019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:50.986704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:51.225900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:51.237148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-79d03f0e-c592-4f12-afcd-537e6e1cd28d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.273387 Apr 08 12:15:51.238106 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 94/202] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:50 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:51.765521 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e141d1e3-d89d-4555-b4dc-9fbd416d7b3a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:51.766741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e141d1e3-d89d-4555-b4dc-9fbd416d7b3a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:51.774997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e141d1e3-d89d-4555-b4dc-9fbd416d7b3a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:51.775500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e141d1e3-d89d-4555-b4dc-9fbd416d7b3a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:51.776339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e141d1e3-d89d-4555-b4dc-9fbd416d7b3a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:51.776835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e141d1e3-d89d-4555-b4dc-9fbd416d7b3a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:51.909351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6f308a2b-ade9-4412-b6bf-d97b88e05773 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:51.911162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6f308a2b-ade9-4412-b6bf-d97b88e05773 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:51.911795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e141d1e3-d89d-4555-b4dc-9fbd416d7b3a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28129 microversion: 2.1 time: 0.150189 Apr 08 12:15:51.912742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 109/203] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:51 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28129 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:51.919192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f308a2b-ade9-4412-b6bf-d97b88e05773 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:51.919699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f308a2b-ade9-4412-b6bf-d97b88e05773 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:51.920549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f308a2b-ade9-4412-b6bf-d97b88e05773 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:51.921047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f308a2b-ade9-4412-b6bf-d97b88e05773 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:52.039952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6f308a2b-ade9-4412-b6bf-d97b88e05773 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 23223 microversion: 2.20 time: 0.134403 Apr 08 12:15:52.040648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 95/204] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:51 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 23223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:15:52.255702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:52.256468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:52.265031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:52.265541 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:52.266591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:52.267083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:52.531911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:52.541494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-02bc046a-84b3-4dab-a8c4-0a26c7dfb37e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.290527 Apr 08 12:15:52.542128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 110/205] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:52 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:52.924765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c22df6d0-a981-4b33-8653-76bb75cbec24 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:52.926910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c22df6d0-a981-4b33-8653-76bb75cbec24 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:52.935838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c22df6d0-a981-4b33-8653-76bb75cbec24 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:52.936359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c22df6d0-a981-4b33-8653-76bb75cbec24 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:52.937204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c22df6d0-a981-4b33-8653-76bb75cbec24 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:52.937715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c22df6d0-a981-4b33-8653-76bb75cbec24 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:53.053075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0e465e32-b087-4d32-ae93-c25afd405f7d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:53.054121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0e465e32-b087-4d32-ae93-c25afd405f7d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:53.062035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e465e32-b087-4d32-ae93-c25afd405f7d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:53.062582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e465e32-b087-4d32-ae93-c25afd405f7d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:53.063422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e465e32-b087-4d32-ae93-c25afd405f7d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:53.063915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e465e32-b087-4d32-ae93-c25afd405f7d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:53.071891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c22df6d0-a981-4b33-8653-76bb75cbec24 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28420 microversion: 2.1 time: 0.151417 Apr 08 12:15:53.073165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 96/206] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:52 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28420 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:53.184069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0e465e32-b087-4d32-ae93-c25afd405f7d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 24212 microversion: 2.20 time: 0.135169 Apr 08 12:15:53.186399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 111/207] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:53 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 24212 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:15:53.368173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2058303883", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "3ba216da-ab5f-4265-9387-3aaa52f8d07f"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:53.450597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] validate_networks() for [('3ba216da-ab5f-4265-9387-3aaa52f8d07f', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:15:53.560268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:53.561155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:53.573967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:53.574495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:53.575343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:53.575830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:53.832726 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:53.841908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c39b9a4d-087a-4aae-8a65-62b371b4cab8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.286286 Apr 08 12:15:53.842777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 112/208] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:53 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:54.072914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:15:54.073408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:15:54.073968 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:15:54.074481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:15:54.074951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:15:54.084740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eb0f4228-1648-4f11-8046-8e19d507f157 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:54.086082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eb0f4228-1648-4f11-8046-8e19d507f157 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:54.094567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb0f4228-1648-4f11-8046-8e19d507f157 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.095197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb0f4228-1648-4f11-8046-8e19d507f157 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:54.095446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.095896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:54.096296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb0f4228-1648-4f11-8046-8e19d507f157 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.096767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.096894 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eb0f4228-1648-4f11-8046-8e19d507f157 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:54.097310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:54.140480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:15:54.145685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for user 12ac1ec4656f4449ac95090c4a6c9b27 and project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:15:54.158119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:15:54.161319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:15:54.212361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-eb0f4228-1648-4f11-8046-8e19d507f157 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28473 microversion: 2.1 time: 0.132188 Apr 08 12:15:54.213222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 113/209] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:54 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28473 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:15:54.220533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7d66c5de-f199-4bde-9d4d-5a7e0fb4e27f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:54.221690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7d66c5de-f199-4bde-9d4d-5a7e0fb4e27f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:54.230660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d66c5de-f199-4bde-9d4d-5a7e0fb4e27f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.231170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d66c5de-f199-4bde-9d4d-5a7e0fb4e27f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:54.232002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d66c5de-f199-4bde-9d4d-5a7e0fb4e27f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.232623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d66c5de-f199-4bde-9d4d-5a7e0fb4e27f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:54.359288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7d66c5de-f199-4bde-9d4d-5a7e0fb4e27f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 25230 microversion: 2.20 time: 0.142375 Apr 08 12:15:54.359288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 114/210] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:54 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 25230 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:15:54.367043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-239df7ec-a211-4689-9bdc-6fdadc25d68f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003193 Apr 08 12:15:54.368027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 97/211] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:15:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:15:54.380096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2415735b-123c-451d-a7f4-d255d2eded36 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:54.381405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2415735b-123c-451d-a7f4-d255d2eded36 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:54.477670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2415735b-123c-451d-a7f4-d255d2eded36 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:54.490589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2415735b-123c-451d-a7f4-d255d2eded36 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1218 microversion: 2.1 time: 0.115507 Apr 08 12:15:54.491409 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 115/212] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:54 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:54.861908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:54.862622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:54.873234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.873936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:54.874857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:54.875350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:55.118629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:55.127898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-751c12f7-b330-479b-80f4-6897edfc37e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.270337 Apr 08 12:15:55.129074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 98/213] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:54 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:55.225063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bd284dcc-0fef-4541-b8c7-6f234a81e623 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:55.226210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bd284dcc-0fef-4541-b8c7-6f234a81e623 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:55.236055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bd284dcc-0fef-4541-b8c7-6f234a81e623 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:55.239927 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bd284dcc-0fef-4541-b8c7-6f234a81e623 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:55.239927 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bd284dcc-0fef-4541-b8c7-6f234a81e623 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:55.239927 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bd284dcc-0fef-4541-b8c7-6f234a81e623 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:55.359274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bd284dcc-0fef-4541-b8c7-6f234a81e623 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28587 microversion: 2.1 time: 0.138471 Apr 08 12:15:55.364204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 116/214] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:55 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28587 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:55.369992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-79cac504-95af-43e0-9dec-3f2f2e942cd8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:55.371225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-79cac504-95af-43e0-9dec-3f2f2e942cd8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:55.380514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79cac504-95af-43e0-9dec-3f2f2e942cd8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:55.381451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79cac504-95af-43e0-9dec-3f2f2e942cd8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:55.382488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79cac504-95af-43e0-9dec-3f2f2e942cd8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:55.383321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79cac504-95af-43e0-9dec-3f2f2e942cd8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:55.500997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-79cac504-95af-43e0-9dec-3f2f2e942cd8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 26042 microversion: 2.20 time: 0.134833 Apr 08 12:15:55.502252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 99/215] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:55 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 26042 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:15:55.510653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:55.513202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:55.520341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:55.520848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:55.521695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:55.522188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:55.668586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:55.678786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ee14c7ab-c10c-4441-96b2-ab734b2bd4d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1222 microversion: 2.1 time: 0.172591 Apr 08 12:15:55.680338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 117/216] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:55 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:56.149436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:56.150221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:56.162772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.163517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.168768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.169410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.372876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f160c060-d03e-4c51-a59c-449ce3c31b9a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:56.374653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f160c060-d03e-4c51-a59c-449ce3c31b9a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:56.377139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:56.383959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f160c060-d03e-4c51-a59c-449ce3c31b9a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.384718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f160c060-d03e-4c51-a59c-449ce3c31b9a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.385936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f160c060-d03e-4c51-a59c-449ce3c31b9a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.386672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f160c060-d03e-4c51-a59c-449ce3c31b9a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.387827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-67844aa8-94a5-4faf-a469-51018198eebb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.243992 Apr 08 12:15:56.388470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 100/217] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:56 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:56.505220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f160c060-d03e-4c51-a59c-449ce3c31b9a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28587 microversion: 2.1 time: 0.136451 Apr 08 12:15:56.510072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 118/218] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:56 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28587 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:56.514069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-466105c5-a19f-4423-90cd-7e0d7a10c2d4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:56.515532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-466105c5-a19f-4423-90cd-7e0d7a10c2d4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:56.526699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-466105c5-a19f-4423-90cd-7e0d7a10c2d4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.527938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-466105c5-a19f-4423-90cd-7e0d7a10c2d4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.528979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-466105c5-a19f-4423-90cd-7e0d7a10c2d4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.529744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-466105c5-a19f-4423-90cd-7e0d7a10c2d4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.679036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-466105c5-a19f-4423-90cd-7e0d7a10c2d4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 26883 microversion: 2.20 time: 0.169247 Apr 08 12:15:56.682930 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 101/219] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:56 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 26883 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:15:56.699249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:56.700772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:56.715825 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.717554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.718586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:56.719277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:56.888886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:56.902276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-13ae15bf-914b-4e41-8ca2-a91c7ef0c785 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1278 microversion: 2.1 time: 0.208159 Apr 08 12:15:56.903832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 119/220] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:56 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:57.408200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:57.408979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:57.433226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.435250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:57.436157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.436685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:57.519633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9e5c4bfd-0642-490f-a75a-2a5f371cf0a4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:57.520934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9e5c4bfd-0642-490f-a75a-2a5f371cf0a4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:57.532194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e5c4bfd-0642-490f-a75a-2a5f371cf0a4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.535054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e5c4bfd-0642-490f-a75a-2a5f371cf0a4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:57.535054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e5c4bfd-0642-490f-a75a-2a5f371cf0a4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.535054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e5c4bfd-0642-490f-a75a-2a5f371cf0a4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:57.680546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9e5c4bfd-0642-490f-a75a-2a5f371cf0a4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28587 microversion: 2.1 time: 0.166591 Apr 08 12:15:57.681688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 120/221] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:57 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28587 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:57.684021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:57.692994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a9f1f65f-17b9-40f9-b50d-42283379646d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:57.694093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a9f1f65f-17b9-40f9-b50d-42283379646d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:57.696398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a768e4c7-46e7-4b76-ba50-9f9a74deb3bb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.292268 Apr 08 12:15:57.707794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 102/222] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:57 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:57.710910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9f1f65f-17b9-40f9-b50d-42283379646d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.711429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9f1f65f-17b9-40f9-b50d-42283379646d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:57.712414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9f1f65f-17b9-40f9-b50d-42283379646d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.712911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9f1f65f-17b9-40f9-b50d-42283379646d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:57.863816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a9f1f65f-17b9-40f9-b50d-42283379646d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 27619 microversion: 2.20 time: 0.176029 Apr 08 12:15:57.866270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 121/223] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:57 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 27619 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:15:57.923826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:57.928671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:57.936700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.937219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:57.938081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:57.938699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:58.259693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:58.270916 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7dfb69df-28d9-446e-9b98-cd97ab80c5fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.353474 Apr 08 12:15:58.271964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 103/224] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:57 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:58.699832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-93c1ddc5-da14-492f-8edc-766473a79164 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:58.700971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-93c1ddc5-da14-492f-8edc-766473a79164 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:58.712808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c1ddc5-da14-492f-8edc-766473a79164 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:58.713322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c1ddc5-da14-492f-8edc-766473a79164 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:58.714167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c1ddc5-da14-492f-8edc-766473a79164 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:58.714331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:58.714971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:58.715680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c1ddc5-da14-492f-8edc-766473a79164 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:58.728504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:58.730260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:58.731217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:58.731724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:58.834864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-93c1ddc5-da14-492f-8edc-766473a79164 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28587 microversion: 2.1 time: 0.140000 Apr 08 12:15:58.839640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 122/225] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:58 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28587 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:15:58.879302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1008e89d-1f35-4795-8ff6-83326cd971cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:58.880601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1008e89d-1f35-4795-8ff6-83326cd971cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:58.892416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1008e89d-1f35-4795-8ff6-83326cd971cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:58.893290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1008e89d-1f35-4795-8ff6-83326cd971cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:58.894671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1008e89d-1f35-4795-8ff6-83326cd971cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:58.895272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1008e89d-1f35-4795-8ff6-83326cd971cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:59.078914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1008e89d-1f35-4795-8ff6-83326cd971cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 27892 microversion: 2.20 time: 0.203780 Apr 08 12:15:59.079880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 123/226] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:15:58 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 27892 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:15:59.274074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:59.283042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c7c48ac9-2159-45a7-863b-a3b931c375da tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.573248 Apr 08 12:15:59.283646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 104/227] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:58 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:15:59.291799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:15:59.293190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:59.303332 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:59.303666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:59.304641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:59.305134 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:59.846321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cf795432-b3a5-482e-b0a9-3ec766c062d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:15:59.848330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cf795432-b3a5-482e-b0a9-3ec766c062d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:15:59.856457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf795432-b3a5-482e-b0a9-3ec766c062d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:59.857008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf795432-b3a5-482e-b0a9-3ec766c062d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:59.857857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf795432-b3a5-482e-b0a9-3ec766c062d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:15:59.858475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf795432-b3a5-482e-b0a9-3ec766c062d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:15:59.893035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:15:59.914949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1012c75a-25de-4010-af0b-5b50e0e2c6ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.628817 Apr 08 12:15:59.915593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 124/228] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:15:59 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:00.065114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cf795432-b3a5-482e-b0a9-3ec766c062d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28587 microversion: 2.1 time: 0.222690 Apr 08 12:16:00.066318 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 105/229] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:15:59 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28587 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:00.092057 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1e404fa7-ca0a-4e28-a6be-923584922d64 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:00.093092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1e404fa7-ca0a-4e28-a6be-923584922d64 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:00.101771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e404fa7-ca0a-4e28-a6be-923584922d64 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:00.102531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e404fa7-ca0a-4e28-a6be-923584922d64 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:00.103553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e404fa7-ca0a-4e28-a6be-923584922d64 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:00.104191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e404fa7-ca0a-4e28-a6be-923584922d64 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:00.163882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-1b0a2565-cba3-466b-a6a6-6a8cdc5e423b req-3381303c-3b14-44fb-be17-1768caec4592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375264eb-09f6-4413-9158-84ecfa8a4c9a", "tag": "c29b9742-45bf-41e2-8335-cb85ed46dc8d"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:00.165995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:00.165995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:00.177170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1b0a2565-cba3-466b-a6a6-6a8cdc5e423b req-3381303c-3b14-44fb-be17-1768caec4592 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:00.177681 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1b0a2565-cba3-466b-a6a6-6a8cdc5e423b req-3381303c-3b14-44fb-be17-1768caec4592 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:00.195566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-1b0a2565-cba3-466b-a6a6-6a8cdc5e423b req-3381303c-3b14-44fb-be17-1768caec4592 service nova] Creating event network-changed:c29b9742-45bf-41e2-8335-cb85ed46dc8d for instance 375264eb-09f6-4413-9158-84ecfa8a4c9a on hv-cinder-78477 Apr 08 12:16:00.200673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-1b0a2565-cba3-466b-a6a6-6a8cdc5e423b req-3381303c-3b14-44fb-be17-1768caec4592 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041886 Apr 08 12:16:00.201310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 106/230] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:00.236795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1e404fa7-ca0a-4e28-a6be-923584922d64 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28034 microversion: 2.20 time: 0.144352 Apr 08 12:16:00.236795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 125/231] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:00 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28034 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:00.303449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:00.304244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:00.314366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:00.315023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:00.316323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:00.317162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:00.540394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:00.549855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-326ee1f5-8123-41f3-8592-69f9b2e81013 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.252295 Apr 08 12:16:00.550632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 107/232] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:00 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:00.933434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:00.934199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:00.943730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:00.944242 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:00.945090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:00.945582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:01.082880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ba5d4512-a4bc-44cc-a298-d216123b09f9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:01.084492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ba5d4512-a4bc-44cc-a298-d216123b09f9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:01.095124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ba5d4512-a4bc-44cc-a298-d216123b09f9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:01.096016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ba5d4512-a4bc-44cc-a298-d216123b09f9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:01.097650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ba5d4512-a4bc-44cc-a298-d216123b09f9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:01.098369 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ba5d4512-a4bc-44cc-a298-d216123b09f9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:01.239241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ba5d4512-a4bc-44cc-a298-d216123b09f9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 28587 microversion: 2.1 time: 0.165214 Apr 08 12:16:01.240181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 108/233] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:01 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 28587 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:01.246083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5a66ad0a-5aa8-4dde-824a-9f80be48c34c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:01.247896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5a66ad0a-5aa8-4dde-824a-9f80be48c34c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:01.258034 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5a66ad0a-5aa8-4dde-824a-9f80be48c34c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:01.258600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5a66ad0a-5aa8-4dde-824a-9f80be48c34c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:01.259463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5a66ad0a-5aa8-4dde-824a-9f80be48c34c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:01.259955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5a66ad0a-5aa8-4dde-824a-9f80be48c34c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:01.391629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5a66ad0a-5aa8-4dde-824a-9f80be48c34c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28201 microversion: 2.20 time: 0.149778 Apr 08 12:16:01.392516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 109/234] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:01 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28201 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:16:01.448052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:01.460822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9edbe719-7ac5-451d-977d-d280e8ea7bdf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.530692 Apr 08 12:16:01.463733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 126/235] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:00 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:01.569514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:01.570603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:01.580890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:01.582669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:01.583924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:01.585081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:01.867232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:01.884598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c8352627-66aa-4ad6-aac2-9a91282c870a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.320527 Apr 08 12:16:01.885248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 110/236] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:01 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:02.252806 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e92ae888-00fd-4858-82d2-b42c42cf1bcc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:02.254627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e92ae888-00fd-4858-82d2-b42c42cf1bcc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:02.263224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e92ae888-00fd-4858-82d2-b42c42cf1bcc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.263738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e92ae888-00fd-4858-82d2-b42c42cf1bcc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:02.264696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e92ae888-00fd-4858-82d2-b42c42cf1bcc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.265188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e92ae888-00fd-4858-82d2-b42c42cf1bcc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:02.385996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e92ae888-00fd-4858-82d2-b42c42cf1bcc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 29598 microversion: 2.1 time: 0.136893 Apr 08 12:16:02.387305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 127/237] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:02 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 29598 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:02.404549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a1c028aa-7ff4-4b7f-973c-12f76425949d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:02.405849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a1c028aa-7ff4-4b7f-973c-12f76425949d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:02.414650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1c028aa-7ff4-4b7f-973c-12f76425949d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.417680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1c028aa-7ff4-4b7f-973c-12f76425949d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:02.417680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1c028aa-7ff4-4b7f-973c-12f76425949d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.417680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1c028aa-7ff4-4b7f-973c-12f76425949d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:02.482444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:02.483089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:02.493024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.493540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:02.494447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.494948 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:02.534228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a1c028aa-7ff4-4b7f-973c-12f76425949d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28201 microversion: 2.20 time: 0.133456 Apr 08 12:16:02.539795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 111/238] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:02 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28201 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:02.712324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:02.721082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-62910939-18e5-4eb4-aff1-8de580950e4d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.243280 Apr 08 12:16:02.722716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 128/239] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:02 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:02.907219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:02.907924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:02.917087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.917596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:02.918453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:02.918951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:03.128607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:03.139180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a45c8b6c-e25a-4869-b622-62064cff2e21 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.236627 Apr 08 12:16:03.139819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 112/240] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:02 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:03.398347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1ad103dc-66d9-4b8a-9857-edfed516ed4b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:03.399491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1ad103dc-66d9-4b8a-9857-edfed516ed4b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:03.407471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ad103dc-66d9-4b8a-9857-edfed516ed4b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:03.407990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ad103dc-66d9-4b8a-9857-edfed516ed4b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:03.408977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ad103dc-66d9-4b8a-9857-edfed516ed4b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:03.409473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ad103dc-66d9-4b8a-9857-edfed516ed4b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:03.528683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1ad103dc-66d9-4b8a-9857-edfed516ed4b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 30758 microversion: 2.1 time: 0.134922 Apr 08 12:16:03.529371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 129/241] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:03 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 30758 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:03.547742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cff389dc-59bb-4b91-99a9-4a9ba8cf6fb0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:03.548790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cff389dc-59bb-4b91-99a9-4a9ba8cf6fb0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:03.557203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff389dc-59bb-4b91-99a9-4a9ba8cf6fb0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:03.557721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff389dc-59bb-4b91-99a9-4a9ba8cf6fb0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:03.558595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff389dc-59bb-4b91-99a9-4a9ba8cf6fb0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:03.559101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff389dc-59bb-4b91-99a9-4a9ba8cf6fb0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:03.678587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cff389dc-59bb-4b91-99a9-4a9ba8cf6fb0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28327 microversion: 2.20 time: 0.134549 Apr 08 12:16:03.680276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 113/242] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:03 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:03.740647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:03.741371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:03.751207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:03.751719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:03.752620 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:03.753790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:03.955309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:03.964740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8a8ed099-61bc-48b7-8352-f4a78a2128ff tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.229862 Apr 08 12:16:03.965628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 130/243] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:03 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:04.161146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:04.161978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:04.170241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.170977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:04.171663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.172166 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:04.546175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-374f7b20-e1ae-498b-aac9-1b91f03cb480 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:04.547804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-374f7b20-e1ae-498b-aac9-1b91f03cb480 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:04.555267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:04.557258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-374f7b20-e1ae-498b-aac9-1b91f03cb480 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.557732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-374f7b20-e1ae-498b-aac9-1b91f03cb480 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:04.558593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-374f7b20-e1ae-498b-aac9-1b91f03cb480 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.559493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-374f7b20-e1ae-498b-aac9-1b91f03cb480 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:04.565585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c33b65db-02d2-41bf-afc9-dd4484192b99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.411957 Apr 08 12:16:04.575647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 114/244] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:04 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:04.694644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-374f7b20-e1ae-498b-aac9-1b91f03cb480 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 31781 microversion: 2.1 time: 0.156878 Apr 08 12:16:04.695606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 131/245] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:04 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 31781 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:04.710744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-12311a3c-58b9-405d-b7df-26dc40e10ed1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:04.712420 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-12311a3c-58b9-405d-b7df-26dc40e10ed1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:04.756839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12311a3c-58b9-405d-b7df-26dc40e10ed1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.758018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12311a3c-58b9-405d-b7df-26dc40e10ed1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:04.761239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12311a3c-58b9-405d-b7df-26dc40e10ed1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.761946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12311a3c-58b9-405d-b7df-26dc40e10ed1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:04.924812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-12311a3c-58b9-405d-b7df-26dc40e10ed1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28488 microversion: 2.20 time: 0.237033 Apr 08 12:16:04.930184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 115/246] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:04 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28488 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:16:04.984119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:04.984898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:04.993997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.994552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:04.995404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:04.995905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:05.239076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:05.243939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f388415d-89d9-4d87-91a0-b5874b7b305c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.264576 Apr 08 12:16:05.244662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 132/247] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:04 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:05.586027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:05.586932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:05.596095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:05.596603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:05.598061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:05.598597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:05.708412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0c84c8fd-c822-4fab-be74-2656ba693409 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:05.709463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0c84c8fd-c822-4fab-be74-2656ba693409 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:05.719345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c84c8fd-c822-4fab-be74-2656ba693409 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:05.719646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c84c8fd-c822-4fab-be74-2656ba693409 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:05.721505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c84c8fd-c822-4fab-be74-2656ba693409 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:05.722026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c84c8fd-c822-4fab-be74-2656ba693409 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:05.833914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:05.843864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6673f353-7ac5-4662-9516-3962f61a3bf1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.263604 Apr 08 12:16:05.844478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 116/248] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:05 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:05.882279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0c84c8fd-c822-4fab-be74-2656ba693409 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 32559 microversion: 2.1 time: 0.179562 Apr 08 12:16:05.886509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 133/249] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:05 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 32559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:05.937233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-21102c90-d85a-45f4-964d-906b378ac26b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:05.938258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-21102c90-d85a-45f4-964d-906b378ac26b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:05.947100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21102c90-d85a-45f4-964d-906b378ac26b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:05.947591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21102c90-d85a-45f4-964d-906b378ac26b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:05.948434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21102c90-d85a-45f4-964d-906b378ac26b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:05.948960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21102c90-d85a-45f4-964d-906b378ac26b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:06.073133 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-21102c90-d85a-45f4-964d-906b378ac26b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28626 microversion: 2.20 time: 0.139642 Apr 08 12:16:06.077275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 117/250] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:05 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28626 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:06.264718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:06.265718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:06.274911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-a17a91ae-71f0-45a8-96b9-e4c421f14281 req-060308bd-2c9b-46b8-a86c-12f06b4481da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375264eb-09f6-4413-9158-84ecfa8a4c9a", "name": "network-vif-plugged", "status": "completed", "tag": "c29b9742-45bf-41e2-8335-cb85ed46dc8d"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:06.275232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:06.275750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:06.276569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:06.276569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:06.276801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:06.277082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:06.289646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a17a91ae-71f0-45a8-96b9-e4c421f14281 req-060308bd-2c9b-46b8-a86c-12f06b4481da service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:06.290712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a17a91ae-71f0-45a8-96b9-e4c421f14281 req-060308bd-2c9b-46b8-a86c-12f06b4481da service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:06.310331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-a17a91ae-71f0-45a8-96b9-e4c421f14281 req-060308bd-2c9b-46b8-a86c-12f06b4481da service nova] Creating event network-vif-plugged:c29b9742-45bf-41e2-8335-cb85ed46dc8d for instance 375264eb-09f6-4413-9158-84ecfa8a4c9a on hv-cinder-78477 Apr 08 12:16:06.315827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-a17a91ae-71f0-45a8-96b9-e4c421f14281 req-060308bd-2c9b-46b8-a86c-12f06b4481da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048203 Apr 08 12:16:06.316717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 118/251] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:06.587817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:06.597002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a2a660a0-b8cc-4893-a7b4-e1bf36b18cf7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.337967 Apr 08 12:16:06.597614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 134/252] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:06 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:06.863475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:06.864737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:06.873662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:06.874215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:06.875098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:06.875722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:06.895155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f0f066f7-b16b-412f-bbf0-fd5b8c72854f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:06.896122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f0f066f7-b16b-412f-bbf0-fd5b8c72854f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:06.904111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0f066f7-b16b-412f-bbf0-fd5b8c72854f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:06.904633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0f066f7-b16b-412f-bbf0-fd5b8c72854f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:06.905483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0f066f7-b16b-412f-bbf0-fd5b8c72854f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:06.906066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0f066f7-b16b-412f-bbf0-fd5b8c72854f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:07.051673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f0f066f7-b16b-412f-bbf0-fd5b8c72854f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 33184 microversion: 2.1 time: 0.159534 Apr 08 12:16:07.052445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 135/253] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:06 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 33184 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:16:07.087079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-37318b78-1efe-458c-896d-a219ca379455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:07.088333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-37318b78-1efe-458c-896d-a219ca379455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:07.099062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37318b78-1efe-458c-896d-a219ca379455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:07.099175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37318b78-1efe-458c-896d-a219ca379455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:07.100013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37318b78-1efe-458c-896d-a219ca379455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:07.100513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37318b78-1efe-458c-896d-a219ca379455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:07.100840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:07.111734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8d9e9cfa-ed28-4570-8ef7-5f559faa503b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1522 microversion: 2.1 time: 0.254101 Apr 08 12:16:07.113066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 119/254] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:06 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:07.227795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-37318b78-1efe-458c-896d-a219ca379455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28650 microversion: 2.20 time: 0.145989 Apr 08 12:16:07.228489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 136/255] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:07 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:16:07.615797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:07.616689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:07.625518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:07.626160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:07.627810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:07.627810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:07.884605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:07.895483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-22248fb5-8473-46ae-9e7f-a2e594e7f2d4 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1318 microversion: 2.1 time: 0.284116 Apr 08 12:16:07.901757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 120/256] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:07 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:08.065130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-31123055-9abb-4efe-8fee-68afce9a80f3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:08.066881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-31123055-9abb-4efe-8fee-68afce9a80f3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:08.092646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31123055-9abb-4efe-8fee-68afce9a80f3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.093154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31123055-9abb-4efe-8fee-68afce9a80f3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.094030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31123055-9abb-4efe-8fee-68afce9a80f3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.094536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31123055-9abb-4efe-8fee-68afce9a80f3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.131526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:08.132125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:08.148741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.151802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.155505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.157411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.273210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-31123055-9abb-4efe-8fee-68afce9a80f3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 33430 microversion: 2.1 time: 0.212386 Apr 08 12:16:08.274731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 137/257] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:08 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 33430 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:08.281049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1c472d92-81da-4287-857a-9d3fdd77e906 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:08.282262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1c472d92-81da-4287-857a-9d3fdd77e906 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:08.291843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c472d92-81da-4287-857a-9d3fdd77e906 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.292513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c472d92-81da-4287-857a-9d3fdd77e906 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.293516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c472d92-81da-4287-857a-9d3fdd77e906 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.294154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c472d92-81da-4287-857a-9d3fdd77e906 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.436703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:08.446495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c26188d5-2174-4028-83f4-5a580861f3a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1502 microversion: 2.1 time: 0.320052 Apr 08 12:16:08.447775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 121/258] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:08 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:08.460088 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1c472d92-81da-4287-857a-9d3fdd77e906 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28650 microversion: 2.20 time: 0.183382 Apr 08 12:16:08.460786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 138/259] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:08 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28650 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:08.465468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:08.467030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:08.475392 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.475886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.476740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.477239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.695202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:08.704107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-38e79dd3-89f9-4ba7-ac85-8b74f739bcc4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1516 microversion: 2.1 time: 0.242551 Apr 08 12:16:08.705024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 122/260] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:08 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:08.914765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:08.915464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:08.923929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.924437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:08.925514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:08.926139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:09.139335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:09.149056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-642d4b4b-18c4-4c69-b272-0e46260c0022 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1509 microversion: 2.1 time: 0.239590 Apr 08 12:16:09.149666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 139/261] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:08 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:09.289528 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b61a13db-180e-4634-9378-8089790f230f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:09.290697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b61a13db-180e-4634-9378-8089790f230f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:09.306234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b61a13db-180e-4634-9378-8089790f230f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:09.306783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b61a13db-180e-4634-9378-8089790f230f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:09.307645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b61a13db-180e-4634-9378-8089790f230f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:09.308140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b61a13db-180e-4634-9378-8089790f230f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:09.473524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1149db66-d278-4a7e-8a10-18875a788b02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:09.475194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1149db66-d278-4a7e-8a10-18875a788b02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:09.479657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b61a13db-180e-4634-9378-8089790f230f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 33891 microversion: 2.1 time: 0.194564 Apr 08 12:16:09.480560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 123/262] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:09 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 33891 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:09.484397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1149db66-d278-4a7e-8a10-18875a788b02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:09.484397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1149db66-d278-4a7e-8a10-18875a788b02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:09.485162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1149db66-d278-4a7e-8a10-18875a788b02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:09.485711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1149db66-d278-4a7e-8a10-18875a788b02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:09.633394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1149db66-d278-4a7e-8a10-18875a788b02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28650 microversion: 2.20 time: 0.164572 Apr 08 12:16:09.634609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 140/263] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:09 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28650 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:10.496567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f90f2338-889e-460f-8986-aa3070fc7180 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:10.498628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f90f2338-889e-460f-8986-aa3070fc7180 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:10.508902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f90f2338-889e-460f-8986-aa3070fc7180 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.509586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f90f2338-889e-460f-8986-aa3070fc7180 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:10.510606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f90f2338-889e-460f-8986-aa3070fc7180 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.511401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f90f2338-889e-460f-8986-aa3070fc7180 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:10.634550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:10.636654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:10.647078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.648026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:10.649454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.650086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:10.650489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f90f2338-889e-460f-8986-aa3070fc7180 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 34613 microversion: 2.1 time: 0.158046 Apr 08 12:16:10.654821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 124/264] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:10 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 34613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:10.657642 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9512683a-3f0d-4b74-a544-c3180f1ab6fe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:10.663133 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9512683a-3f0d-4b74-a544-c3180f1ab6fe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:10.684584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9512683a-3f0d-4b74-a544-c3180f1ab6fe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.685190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9512683a-3f0d-4b74-a544-c3180f1ab6fe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:10.686072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9512683a-3f0d-4b74-a544-c3180f1ab6fe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.686601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9512683a-3f0d-4b74-a544-c3180f1ab6fe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:10.724191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lazy-loading 'flavor' on Instance uuid d63b515b-cd97-4a20-a16f-7b1f3eba4460 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:16:10.888671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9512683a-3f0d-4b74-a544-c3180f1ab6fe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28650 microversion: 2.20 time: 0.235293 Apr 08 12:16:10.890234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 125/265] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:10 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28650 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:10.922185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-150441c3-a01a-4c1d-b138-45e90f88e7d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fbc7ac-a26a-4cd9-81de-40cdcab38772"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:10.923552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-150441c3-a01a-4c1d-b138-45e90f88e7d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:10.933520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-150441c3-a01a-4c1d-b138-45e90f88e7d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.934029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-150441c3-a01a-4c1d-b138-45e90f88e7d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:10.934908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-150441c3-a01a-4c1d-b138-45e90f88e7d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:10.935370 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-150441c3-a01a-4c1d-b138-45e90f88e7d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:11.031712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0cce833c-0e74-48bf-a4ca-257ff19f5b50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action" status: 200 len: 32 microversion: 2.1 time: 0.402337 Apr 08 12:16:11.032827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 141/266] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:10 2021] POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action => generated 32 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:16:11.044790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:11.046212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:11.056200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:11.057478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:11.057784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:11.058359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:11.413137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:11.426138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a14e42c6-e200-4aa6-bcdd-9d570ebf79e0 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.384923 Apr 08 12:16:11.426138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 142/267] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:11 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:11.651322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-150441c3-a01a-4c1d-b138-45e90f88e7d8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733304 Apr 08 12:16:11.651997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 126/268] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:16:10 2021] POST /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:16:11.664292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8e49a37b-9f1a-4d38-9e51-99c8002c1cb5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:11.665510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8e49a37b-9f1a-4d38-9e51-99c8002c1cb5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:11.676250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e49a37b-9f1a-4d38-9e51-99c8002c1cb5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:11.677557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e49a37b-9f1a-4d38-9e51-99c8002c1cb5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:11.678595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e49a37b-9f1a-4d38-9e51-99c8002c1cb5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:11.679379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e49a37b-9f1a-4d38-9e51-99c8002c1cb5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:11.885386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8e49a37b-9f1a-4d38-9e51-99c8002c1cb5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 35427 microversion: 2.1 time: 0.225918 Apr 08 12:16:11.886455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 143/269] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:11 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 35427 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:11.902407 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-54cbba6c-228c-46bb-8473-9ac111765991 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:11.903645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-54cbba6c-228c-46bb-8473-9ac111765991 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:11.921740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54cbba6c-228c-46bb-8473-9ac111765991 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:11.921740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54cbba6c-228c-46bb-8473-9ac111765991 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:11.921740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54cbba6c-228c-46bb-8473-9ac111765991 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:11.921740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54cbba6c-228c-46bb-8473-9ac111765991 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:12.050798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-54cbba6c-228c-46bb-8473-9ac111765991 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28650 microversion: 2.20 time: 0.147815 Apr 08 12:16:12.051232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 127/270] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:11 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28650 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:12.443994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:12.444766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:12.453733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:12.454248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:12.455178 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:12.455721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:12.661718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:12.670511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e8fd0953-ad5a-469d-b0c7-effa2fce9818 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.231958 Apr 08 12:16:12.671129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 144/271] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:12 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:12.903129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e059fecc-7fa2-4c2e-8156-3ce4406cff44 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:12.904528 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e059fecc-7fa2-4c2e-8156-3ce4406cff44 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:12.914556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e059fecc-7fa2-4c2e-8156-3ce4406cff44 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:12.915205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e059fecc-7fa2-4c2e-8156-3ce4406cff44 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:12.916191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e059fecc-7fa2-4c2e-8156-3ce4406cff44 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:12.916815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e059fecc-7fa2-4c2e-8156-3ce4406cff44 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:13.058834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e059fecc-7fa2-4c2e-8156-3ce4406cff44 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 36201 microversion: 2.1 time: 0.160218 Apr 08 12:16:13.059549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 128/272] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:12 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 36201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:13.063885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d562ae9b-e69e-4b8f-a053-2fce8c92893f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:13.065398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d562ae9b-e69e-4b8f-a053-2fce8c92893f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:13.076200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d562ae9b-e69e-4b8f-a053-2fce8c92893f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:13.076982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d562ae9b-e69e-4b8f-a053-2fce8c92893f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:13.077886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d562ae9b-e69e-4b8f-a053-2fce8c92893f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:13.078455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d562ae9b-e69e-4b8f-a053-2fce8c92893f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:13.269748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d562ae9b-e69e-4b8f-a053-2fce8c92893f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 28665 microversion: 2.20 time: 0.209621 Apr 08 12:16:13.270486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 145/273] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:13 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 28665 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:13.691499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:13.692265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:13.701258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:13.701799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:13.702677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:13.703176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:13.908723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:13.918373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d5a6d9bc-5028-4ec5-9107-9dfc5d604556 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.232816 Apr 08 12:16:13.919031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 129/274] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:13 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:14.073986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5026676a-eb6f-4a1b-8da4-3d0f2881eae9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:14.075149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5026676a-eb6f-4a1b-8da4-3d0f2881eae9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:14.084431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5026676a-eb6f-4a1b-8da4-3d0f2881eae9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:14.084939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5026676a-eb6f-4a1b-8da4-3d0f2881eae9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:14.085779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5026676a-eb6f-4a1b-8da4-3d0f2881eae9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:14.086268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5026676a-eb6f-4a1b-8da4-3d0f2881eae9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:14.268399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5026676a-eb6f-4a1b-8da4-3d0f2881eae9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 36926 microversion: 2.1 time: 0.199172 Apr 08 12:16:14.269488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 146/275] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:14 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 36926 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:16:14.281540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e6cfec5f-1e10-4e63-99bd-4573026bb6ee tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:14.282715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e6cfec5f-1e10-4e63-99bd-4573026bb6ee tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:14.291125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6cfec5f-1e10-4e63-99bd-4573026bb6ee tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:14.291639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6cfec5f-1e10-4e63-99bd-4573026bb6ee tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:14.292471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6cfec5f-1e10-4e63-99bd-4573026bb6ee tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:14.292958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6cfec5f-1e10-4e63-99bd-4573026bb6ee tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:14.427520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e6cfec5f-1e10-4e63-99bd-4573026bb6ee tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 29660 microversion: 2.20 time: 0.149788 Apr 08 12:16:14.428365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 130/276] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:14 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 29660 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:14.938650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:14.940086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:14.950773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:14.951402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:14.952561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:14.953264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:15.197045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:15.209423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1e5d49a0-b2f2-4517-90c4-0714c5a108fb tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.276147 Apr 08 12:16:15.210233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 147/277] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:14 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:15.286194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d7441a77-eb22-4735-a520-dcecd3a38a8b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:15.287442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d7441a77-eb22-4735-a520-dcecd3a38a8b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:15.301842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7441a77-eb22-4735-a520-dcecd3a38a8b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:15.301842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7441a77-eb22-4735-a520-dcecd3a38a8b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:15.301842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7441a77-eb22-4735-a520-dcecd3a38a8b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:15.301842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7441a77-eb22-4735-a520-dcecd3a38a8b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:15.427726 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d7441a77-eb22-4735-a520-dcecd3a38a8b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 37794 microversion: 2.1 time: 0.145957 Apr 08 12:16:15.429466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 131/278] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:15 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 37794 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:15.441817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ca85e6e0-dd86-4219-bc05-590d148f1719 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:15.442968 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ca85e6e0-dd86-4219-bc05-590d148f1719 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:15.450734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca85e6e0-dd86-4219-bc05-590d148f1719 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:15.451239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca85e6e0-dd86-4219-bc05-590d148f1719 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:15.452074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca85e6e0-dd86-4219-bc05-590d148f1719 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:15.452563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca85e6e0-dd86-4219-bc05-590d148f1719 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:15.564319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ca85e6e0-dd86-4219-bc05-590d148f1719 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 30631 microversion: 2.20 time: 0.127209 Apr 08 12:16:15.565733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 148/279] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:15 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 30631 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:16.236900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:16.239249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:16.248031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:16.248543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:16.249381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:16.249875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:16.441243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b1032c66-f91f-4b2d-83ce-5c9c87872548 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:16.442944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b1032c66-f91f-4b2d-83ce-5c9c87872548 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:16.455147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1032c66-f91f-4b2d-83ce-5c9c87872548 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:16.456364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1032c66-f91f-4b2d-83ce-5c9c87872548 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:16.458924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1032c66-f91f-4b2d-83ce-5c9c87872548 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:16.458924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1032c66-f91f-4b2d-83ce-5c9c87872548 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:16.502886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:16.512095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d0208b8b-2810-456e-9c76-426d766098e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.279534 Apr 08 12:16:16.516280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 132/280] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:16 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:16.580760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-791d58ac-9e75-4cec-9821-7f0988291f56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:16.582331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-791d58ac-9e75-4cec-9821-7f0988291f56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:16.590211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-791d58ac-9e75-4cec-9821-7f0988291f56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:16.590767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-791d58ac-9e75-4cec-9821-7f0988291f56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:16.591645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-791d58ac-9e75-4cec-9821-7f0988291f56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:16.592156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-791d58ac-9e75-4cec-9821-7f0988291f56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:16.616949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b1032c66-f91f-4b2d-83ce-5c9c87872548 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 38064 microversion: 2.1 time: 0.180035 Apr 08 12:16:16.619405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 149/281] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:16 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 38064 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:16.751911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-791d58ac-9e75-4cec-9821-7f0988291f56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 31731 microversion: 2.20 time: 0.175049 Apr 08 12:16:16.753176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 133/282] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:16 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 31731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:16:17.530805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:17.531486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:17.540776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:17.541374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:17.542245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:17.542611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:17.630742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c9c3f564-3eac-476c-90be-828c05c93c13 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:17.631884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c9c3f564-3eac-476c-90be-828c05c93c13 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:17.640550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c3f564-3eac-476c-90be-828c05c93c13 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:17.641073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c3f564-3eac-476c-90be-828c05c93c13 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:17.642285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c3f564-3eac-476c-90be-828c05c93c13 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:17.642813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c3f564-3eac-476c-90be-828c05c93c13 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:17.776047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c9c3f564-3eac-476c-90be-828c05c93c13 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 38130 microversion: 2.1 time: 0.149691 Apr 08 12:16:17.776773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 134/283] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:17 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 38130 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:17.783067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5b5c84a8-f5db-4944-a9b9-a630cce417e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:17.785163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5b5c84a8-f5db-4944-a9b9-a630cce417e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:17.795010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b5c84a8-f5db-4944-a9b9-a630cce417e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:17.795521 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b5c84a8-f5db-4944-a9b9-a630cce417e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:17.796396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b5c84a8-f5db-4944-a9b9-a630cce417e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:17.796890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b5c84a8-f5db-4944-a9b9-a630cce417e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:17.932617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5b5c84a8-f5db-4944-a9b9-a630cce417e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 32414 microversion: 2.20 time: 0.153241 Apr 08 12:16:17.934854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 135/284] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:17 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 32414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:17.977953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:17.987451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-132ba160-aad8-45fe-b3d6-2116d82e81d8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.461096 Apr 08 12:16:17.988067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 150/285] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:17 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:18.790821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3ba24412-28e6-4532-8f2e-f0dc651c2599 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:18.791964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3ba24412-28e6-4532-8f2e-f0dc651c2599 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:18.801988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ba24412-28e6-4532-8f2e-f0dc651c2599 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:18.802558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ba24412-28e6-4532-8f2e-f0dc651c2599 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:18.803670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ba24412-28e6-4532-8f2e-f0dc651c2599 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:18.804144 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ba24412-28e6-4532-8f2e-f0dc651c2599 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:18.933727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3ba24412-28e6-4532-8f2e-f0dc651c2599 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 200 len: 38193 microversion: 2.1 time: 0.147839 Apr 08 12:16:18.934684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 136/286] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:18 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 38193 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:18.944876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aa77e268-051e-48e3-a881-f891a8ea94ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:18.946436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aa77e268-051e-48e3-a881-f891a8ea94ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:18.948547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-32f43dd9-7b23-40eb-aebc-0e0d9330449b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:18.949670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-32f43dd9-7b23-40eb-aebc-0e0d9330449b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:18.953887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa77e268-051e-48e3-a881-f891a8ea94ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:18.954446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa77e268-051e-48e3-a881-f891a8ea94ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:18.955296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa77e268-051e-48e3-a881-f891a8ea94ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:18.955799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa77e268-051e-48e3-a881-f891a8ea94ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:18.958723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f43dd9-7b23-40eb-aebc-0e0d9330449b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:18.959241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f43dd9-7b23-40eb-aebc-0e0d9330449b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:18.960086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f43dd9-7b23-40eb-aebc-0e0d9330449b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:18.960795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32f43dd9-7b23-40eb-aebc-0e0d9330449b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:19.036287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aa77e268-051e-48e3-a881-f891a8ea94ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/ips" status: 200 len: 145 microversion: 2.1 time: 0.095393 Apr 08 12:16:19.037165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 151/287] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Apr 8 12:16:18 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/ips => generated 145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:19.042109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:19.042975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:19.051555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:19.052289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:19.053135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:19.053631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:19.094203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-32f43dd9-7b23-40eb-aebc-0e0d9330449b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 32948 microversion: 2.20 time: 0.149982 Apr 08 12:16:19.095143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 137/288] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:18 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 32948 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:16:19.261143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:19.270771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5c72817c-ab0d-4d81-ac46-816d7e563d1a tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.232236 Apr 08 12:16:19.271421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 152/289] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:19 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:19.717811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fbc7ac-a26a-4cd9-81de-40cdcab38772"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:19.719225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:19.727825 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:19.728344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:19.729193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:19.729694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:19.904211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] HTTP exception thrown: Invalid volume: volume e9fbc7ac-a26a-4cd9-81de-40cdcab38772 is already attached to instances: 375264eb-09f6-4413-9158-84ecfa8a4c9a Apr 08 12:16:19.904898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Returning 400 to user: Invalid volume: volume e9fbc7ac-a26a-4cd9-81de-40cdcab38772 is already attached to instances: 375264eb-09f6-4413-9158-84ecfa8a4c9a {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:16:19.905811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-70cf39b5-9de5-418b-8999-084099d1b7dc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.193019 Apr 08 12:16:19.906447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 138/290] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:16:19 2021] POST /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a/os-volume_attachments => generated 174 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 12:16:20.023891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:20.024229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:20.033090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:20.033785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:20.034752 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:20.035291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:20.107648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-15275124-97dd-45f6-ad24-958b40a4d5aa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:20.108690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-15275124-97dd-45f6-ad24-958b40a4d5aa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:20.120013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15275124-97dd-45f6-ad24-958b40a4d5aa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:20.120739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15275124-97dd-45f6-ad24-958b40a4d5aa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:20.121778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15275124-97dd-45f6-ad24-958b40a4d5aa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:20.122494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15275124-97dd-45f6-ad24-958b40a4d5aa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:20.225981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lazy-loading 'services' on Instance uuid 375264eb-09f6-4413-9158-84ecfa8a4c9a {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:16:20.249068 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-15275124-97dd-45f6-ad24-958b40a4d5aa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 33572 microversion: 2.20 time: 0.145254 Apr 08 12:16:20.250089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 139/291] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:20 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 33572 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:16:20.290123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:20.290917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:20.300420 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:20.300928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:20.301779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:20.302263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:20.447545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b9131400-1de4-4b4b-b539-6aa571b6cae0 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a/os-volume_attachments/e9fbc7ac-a26a-4cd9-81de-40cdcab38772" status: 202 len: 0 microversion: 2.1 time: 0.427867 Apr 08 12:16:20.448447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 153/292] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:16:20 2021] DELETE /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a/os-volume_attachments/e9fbc7ac-a26a-4cd9-81de-40cdcab38772 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:20.588866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:20.612761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a4587082-4913-405b-98b3-035bd9206da2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.326650 Apr 08 12:16:20.617967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 140/293] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:20 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:21.264243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-87cc3127-2b99-41e6-ae41-6258f81ecdc7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:21.266119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-87cc3127-2b99-41e6-ae41-6258f81ecdc7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:21.275728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-87cc3127-2b99-41e6-ae41-6258f81ecdc7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:21.285114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-87cc3127-2b99-41e6-ae41-6258f81ecdc7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:21.287347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-87cc3127-2b99-41e6-ae41-6258f81ecdc7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:21.290958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-87cc3127-2b99-41e6-ae41-6258f81ecdc7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:21.492401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-87cc3127-2b99-41e6-ae41-6258f81ecdc7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 34564 microversion: 2.20 time: 0.232589 Apr 08 12:16:21.493099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 154/294] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:21 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 34564 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:21.633306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:21.634357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:21.644450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:21.644968 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:21.645846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:21.646607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:21.933900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:21.946593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-461f19f3-c7ad-4bf6-b864-0cc09afbee1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.317531 Apr 08 12:16:21.947828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 141/295] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:21 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:22.506124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b1e3419d-9d5a-4136-b73a-7f539ffbd886 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:22.507559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b1e3419d-9d5a-4136-b73a-7f539ffbd886 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:22.516066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e3419d-9d5a-4136-b73a-7f539ffbd886 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:22.516850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e3419d-9d5a-4136-b73a-7f539ffbd886 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:22.517686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e3419d-9d5a-4136-b73a-7f539ffbd886 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:22.519113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1e3419d-9d5a-4136-b73a-7f539ffbd886 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:22.566425 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d31329fb-00bd-40f7-8edd-63e037a311b2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51cabf24-d23a-4fcd-bd3d-91b8934cfbe0"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:22.567600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d31329fb-00bd-40f7-8edd-63e037a311b2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:22.587145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d31329fb-00bd-40f7-8edd-63e037a311b2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:22.588907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d31329fb-00bd-40f7-8edd-63e037a311b2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:22.591091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d31329fb-00bd-40f7-8edd-63e037a311b2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:22.591652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d31329fb-00bd-40f7-8edd-63e037a311b2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:25.431857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b1e3419d-9d5a-4136-b73a-7f539ffbd886 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 37829 microversion: 2.20 time: 2.929873 Apr 08 12:16:25.436327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 155/296] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:22 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 37829 bytes in 2932 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:25.438468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2122090302", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "3ba216da-ab5f-4265-9387-3aaa52f8d07f"}]}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:25.535525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] validate_networks() for [('3ba216da-ab5f-4265-9387-3aaa52f8d07f', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:16:25.775415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d31329fb-00bd-40f7-8edd-63e037a311b2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.213445 Apr 08 12:16:25.776379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 142/297] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:16:22 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/os-volume_attachments => generated 194 bytes in 3215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:25.782224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:25.784296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:25.796814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:25.797474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:25.798510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:25.800048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:26.072663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:26.082907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2eecdb06-c3ea-4a15-9f4d-228e6901a914 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.305038 Apr 08 12:16:26.083680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 143/298] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:25 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:26.155474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:16:26.155976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:16:26.156667 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:16:26.157231 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:16:26.157812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:16:26.168145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:26.168655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:26.169546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:26.170046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:26.192419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:16:26.197082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Getting quotas for user 12ac1ec4656f4449ac95090c4a6c9b27 and project 0104642b5c2d4d15bccda4263a3cbd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:16:26.209434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:16:26.212566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:16:26.369743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b0e76e4c-657f-4f08-9790-cb50e67c9ec9 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935564 Apr 08 12:16:26.370484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 156/299] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:16:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:16:26.381818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1251d37b-e4f8-402d-84b9-3e35525fa534 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:26.383570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1251d37b-e4f8-402d-84b9-3e35525fa534 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:26.446240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-051c2056-7790-4c96-91f9-19163d761346 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:26.447513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-051c2056-7790-4c96-91f9-19163d761346 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:26.464716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-051c2056-7790-4c96-91f9-19163d761346 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:26.465579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-051c2056-7790-4c96-91f9-19163d761346 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:26.467876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-051c2056-7790-4c96-91f9-19163d761346 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:26.468563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-051c2056-7790-4c96-91f9-19163d761346 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:26.473656 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1251d37b-e4f8-402d-84b9-3e35525fa534 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:26.482152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1251d37b-e4f8-402d-84b9-3e35525fa534 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1218 microversion: 2.1 time: 0.104829 Apr 08 12:16:26.484108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 144/300] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:26 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:26.606070 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-051c2056-7790-4c96-91f9-19163d761346 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 38163 microversion: 2.20 time: 0.164596 Apr 08 12:16:26.610659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 157/301] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:26 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 38163 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:16:27.101731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:27.102448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:27.110890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:27.111416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:27.113040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:27.113549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:27.310243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:27.320305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7ba96184-2ea5-42c2-9aad-9be249f15b69 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.222595 Apr 08 12:16:27.320921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 145/302] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:27 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:27.501989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:27.502988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:27.511678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:27.512189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:27.513031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:27.513524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:27.582983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1053113886", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "e78474b0-0267-4206-95c8-f7e7d8afada8"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:27.660059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:27.674465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d96506a4-88c3-40c6-98ff-a9e37735f356 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1270 microversion: 2.1 time: 0.172695 Apr 08 12:16:27.674465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 158/303] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:27 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:27.674655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] validate_networks() for [('e78474b0-0267-4206-95c8-f7e7d8afada8', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:16:27.675324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-557a594c-3011-4e92-be17-cd00f49467ae tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:27.676427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-557a594c-3011-4e92-be17-cd00f49467ae tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:27.684271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-557a594c-3011-4e92-be17-cd00f49467ae tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:27.684774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-557a594c-3011-4e92-be17-cd00f49467ae tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:27.685713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-557a594c-3011-4e92-be17-cd00f49467ae tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:27.686200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-557a594c-3011-4e92-be17-cd00f49467ae tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:27.806127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-557a594c-3011-4e92-be17-cd00f49467ae tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 38163 microversion: 2.20 time: 0.134243 Apr 08 12:16:27.807107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 159/304] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:27 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 38163 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:28.277591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:16:28.278070 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:16:28.278797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:16:28.279702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:16:28.280039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:16:28.290591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:28.291099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:28.291978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:28.292485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:28.313781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Getting quotas for project 59af83a5bec643c1bf2d8a3ede4b9a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:16:28.318803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Getting quotas for user f3786ec5feb8460da013a34f428b22f0 and project 59af83a5bec643c1bf2d8a3ede4b9a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:16:28.332974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:16:28.335242 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:16:28.340105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:28.341374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:28.352651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:28.353361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:28.354413 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:28.355201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:28.460548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cb3d5ae1-69ae-4ad5-8bc7-6319794ba1f7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882484 Apr 08 12:16:28.461367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 146/305] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:16:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:16:28.479589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-de150d61-23ce-41d7-854a-b22fef5d702a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:28.480267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-de150d61-23ce-41d7-854a-b22fef5d702a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:28.668339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-de150d61-23ce-41d7-854a-b22fef5d702a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:28.681632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-de150d61-23ce-41d7-854a-b22fef5d702a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1214 microversion: 2.1 time: 0.206551 Apr 08 12:16:28.682266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 147/306] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:28 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:28.701634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:28.702591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:28.722069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:28.722069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:28.722069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:28.722069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:28.959197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:28.968811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a5ddb976-2732-4f63-b52c-5320051d5fbc tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1288 microversion: 2.1 time: 0.271110 Apr 08 12:16:28.979800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:28.981940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 148/307] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:28 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1288 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:28.987630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-299907ed-4273-4eba-be34-8154eaa9e52d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:28.988774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-299907ed-4273-4eba-be34-8154eaa9e52d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:28.989414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f638049f-47ac-47d9-840a-50e6a654af23 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.654170 Apr 08 12:16:28.999109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 160/308] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:28 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:29.004700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-299907ed-4273-4eba-be34-8154eaa9e52d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:29.005225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-299907ed-4273-4eba-be34-8154eaa9e52d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:29.006099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-299907ed-4273-4eba-be34-8154eaa9e52d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:29.016328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-299907ed-4273-4eba-be34-8154eaa9e52d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:29.289327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-299907ed-4273-4eba-be34-8154eaa9e52d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 200 len: 38304 microversion: 2.20 time: 0.305895 Apr 08 12:16:29.290517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 149/309] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:28 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 38304 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:29.300667 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a0c6ca01-06dd-4be3-ae51-399de741b803 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:29.301220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a0c6ca01-06dd-4be3-ae51-399de741b803 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:29.309641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0c6ca01-06dd-4be3-ae51-399de741b803 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:29.315293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0c6ca01-06dd-4be3-ae51-399de741b803 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:29.315293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0c6ca01-06dd-4be3-ae51-399de741b803 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:29.315293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0c6ca01-06dd-4be3-ae51-399de741b803 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:29.378609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a0c6ca01-06dd-4be3-ae51-399de741b803 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/ips" status: 200 len: 152 microversion: 2.20 time: 0.081816 Apr 08 12:16:29.379531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 161/310] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Apr 8 12:16:29 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/ips => generated 152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:16:29.700886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:29.701664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:29.713380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:29.714487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:29.715441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:29.716028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:29.948479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:29.989623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d3ae7cab-ba03-4ff5-aa47-22f708d4867b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1210 microversion: 2.1 time: 0.287983 Apr 08 12:16:29.989623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 150/311] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:29 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1210 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:30.019371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:30.020219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:30.020513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:30.021576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:30.038165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:30.040507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:30.041110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:30.042828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:30.043268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:30.044342 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:30.045050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:30.045727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:30.352907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:30.363732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fee2f80b-129b-4eb1-bb7e-572a1c0bafab tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.380001 Apr 08 12:16:30.366648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 162/312] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:29 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:30.520790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:30.529922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-06c5cdd0-279a-4f4b-b8e8-65638f67b709 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.515584 Apr 08 12:16:30.541526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 151/313] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:30 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:31.009561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:31.011096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:31.029874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:31.033457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:31.034618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:31.035295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:31.390989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:31.396780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:31.421563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:31.424598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:31.425861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:31.428459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:31.566151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:31.575445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-76efdc63-dc42-414b-b91e-819e6971a244 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1272 microversion: 2.1 time: 0.570388 Apr 08 12:16:31.576076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 163/314] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:31 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1272 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:31.582186 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:31.583291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:31.591736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:31.592234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:31.593616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:31.594237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:31.919682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:31.930270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-059ac5c0-ca34-4bb5-9df1-526a8c8493dd tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.548491 Apr 08 12:16:31.931406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 152/315] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:31 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:31.967377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:31.977462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f0d7a362-9cf8-4792-b759-7a07bb9e56e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.400108 Apr 08 12:16:31.978105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 164/316] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:31 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:32.206946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-c2265139-b18d-4a56-be2a-c0c09a69d57e req-665e7c1e-4206-41e8-af99-3f1b1db61a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537681fb-20cb-416c-8a3a-31a9e4107b84", "tag": "64dad50b-c967-4c4a-a35d-db19f3683de0"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:32.208865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:32.208865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:32.217731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-c2265139-b18d-4a56-be2a-c0c09a69d57e req-665e7c1e-4206-41e8-af99-3f1b1db61a64 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:32.218238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-c2265139-b18d-4a56-be2a-c0c09a69d57e req-665e7c1e-4206-41e8-af99-3f1b1db61a64 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:32.237108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-c2265139-b18d-4a56-be2a-c0c09a69d57e req-665e7c1e-4206-41e8-af99-3f1b1db61a64 service nova] Creating event network-changed:64dad50b-c967-4c4a-a35d-db19f3683de0 for instance 537681fb-20cb-416c-8a3a-31a9e4107b84 on hv-cinder-78477 Apr 08 12:16:32.242418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-c2265139-b18d-4a56-be2a-c0c09a69d57e req-665e7c1e-4206-41e8-af99-3f1b1db61a64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039502 Apr 08 12:16:32.243084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 153/317] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:32.602746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:32.603526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:32.614766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:32.615277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:32.616124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:32.616625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:32.881006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:32.889734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ffaaf8ec-9b50-483b-aa85-5d29f041f0b2 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.291470 Apr 08 12:16:32.890378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 165/318] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:32 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:32.951023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:32.951794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:32.960606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:32.961121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:32.961963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:32.962508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:32.996980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:32.997635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:33.006072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:33.006644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:33.007496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:33.007991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:33.168711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:33.178360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-66c5bd2b-1c43-4bf8-b46f-184a0340bc73 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.231846 Apr 08 12:16:33.179006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 154/319] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:32 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:33.216917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:33.226489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b724f55e-a4b5-479c-a8b8-3fd02f4fef1d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.234165 Apr 08 12:16:33.227099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 166/320] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:32 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:33.907736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:33.908906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:33.917269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:33.917781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:33.918643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:33.919145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:34.185155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:34.194572 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7d1d1ae2-40b0-4034-8f03-af3c4f2e0c27 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.290768 Apr 08 12:16:34.195202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 155/321] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:33 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:34.196291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:34.196968 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:34.205668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:34.206263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:34.206991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:34.207494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:34.245096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:34.245770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:34.254547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:34.255065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:34.255918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:34.256421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:34.403388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:34.413168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-33da8655-a987-4739-9e18-8bc9c628dbc2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.221041 Apr 08 12:16:34.414014 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 167/322] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:34 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:34.462855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:34.473004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fa09ddc9-ce36-4f73-b283-e46d8cc0f387 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.232214 Apr 08 12:16:34.473622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 156/323] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:34 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:35.212891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:35.213629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:35.221916 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.222475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:35.223335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.223837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:35.431866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:35.432543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:35.443838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.444627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:35.445667 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.446507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:35.606012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:35.617720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-91f588c5-4470-4609-b048-228f4e35a5f0 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.409074 Apr 08 12:16:35.628701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 168/324] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:35 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:35.628701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:35.628701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:35.638391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.639111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:35.640156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.640727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:35.736494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lazy-loading 'flavor' on Instance uuid 704586d7-ad35-414f-af0c-5835b542f260 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:16:35.850764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:35.861320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fa7bf178-d0d1-4dd5-bec8-2d9b2a059f5e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.433050 Apr 08 12:16:35.862058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 157/325] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:35 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:35.868382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:35.869055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:35.878598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.879103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:35.879953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:35.880445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.187940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:36.197850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a059e797-42b1-4558-be68-b7e6584413ea tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.334498 Apr 08 12:16:36.198561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 158/326] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:35 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:36.402906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9c0c252a-b857-4f32-9243-fd3eabb32b9d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 202 len: 0 microversion: 2.20 time: 0.782557 Apr 08 12:16:36.403882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 169/327] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:16:35 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:16:36.417031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:36.418451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:36.428185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:36.428994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.430053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:36.430806 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.637637 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:36.638339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:36.648291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:36.648950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.649863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:36.650386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.842953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:36.854088 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:36.856051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:36.857728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-34f5a687-e81b-428d-b94f-c744c019f533 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.447615 Apr 08 12:16:36.869802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 159/328] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:36 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:36.869802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-9e239c2d-eb40-4046-890f-8e7a7c0387c6 req-0c70f474-dc55-45a2-9b42-7ad83a5c82ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a06df7-1733-495d-aca0-367f3478e75a", "tag": "71c435b3-19da-4283-a3b6-0d81d4d1f61d"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:36.869802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:36.869802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:36.885723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9e239c2d-eb40-4046-890f-8e7a7c0387c6 req-0c70f474-dc55-45a2-9b42-7ad83a5c82ab service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:36.886390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9e239c2d-eb40-4046-890f-8e7a7c0387c6 req-0c70f474-dc55-45a2-9b42-7ad83a5c82ab service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.905651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-9e239c2d-eb40-4046-890f-8e7a7c0387c6 req-0c70f474-dc55-45a2-9b42-7ad83a5c82ab service nova] Creating event network-changed:71c435b3-19da-4283-a3b6-0d81d4d1f61d for instance e1a06df7-1733-495d-aca0-367f3478e75a on hv-cinder-78477 Apr 08 12:16:36.916523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-9e239c2d-eb40-4046-890f-8e7a7c0387c6 req-0c70f474-dc55-45a2-9b42-7ad83a5c82ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056298 Apr 08 12:16:36.917786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 160/329] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:36.927399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:36.928399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:36.938768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:36.939578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.942343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:36.943171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:36.960915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:36.975010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c688e10d-c608-4834-9f0b-9738fda1297b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.341967 Apr 08 12:16:36.978998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 170/330] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:36 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:37.132627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4f8d0285-d67c-4388-a440-d5e71a7b5296 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:37.141393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f8d0285-d67c-4388-a440-d5e71a7b5296 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:37.142057 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f8d0285-d67c-4388-a440-d5e71a7b5296 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:37.211585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4f8d0285-d67c-4388-a440-d5e71a7b5296 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Going to try to stop instance {{(pid=98473) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 08 12:16:37.362149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4f8d0285-d67c-4388-a440-d5e71a7b5296 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 202 len: 0 microversion: 2.1 time: 0.232912 Apr 08 12:16:37.362931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 171/331] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:37 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:37.368479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:37.369365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:37.378271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:37.378994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:37.380311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:37.380584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:37.583114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:37.592087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8e4d8a16-2aa1-4a62-90f2-79e37880ad51 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.672707 Apr 08 12:16:37.592877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 161/332] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:36 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:37.600214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:37.600214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:37.606060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:37.606649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:37.607502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:37.607997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:37.648694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:37.657747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c91153ce-9426-44a8-860c-b7fb8d9ebf53 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.293640 Apr 08 12:16:37.658665 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 172/333] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:37 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:37.820872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:37.831147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-22d7edcf-4446-4df2-90cf-5496677e8851 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.237368 Apr 08 12:16:37.835039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 162/334] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:37 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:37.887084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:37.887799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:37.898454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:37.899043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:37.900058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:37.900688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:37.996854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:37.997756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:38.007350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.007863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:38.008711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.009201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:38.210335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:38.219305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0572ecd0-9ae3-4a87-93b0-7d0e1d60746b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.226534 Apr 08 12:16:38.219963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 163/335] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:37 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:38.529742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:38.540230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:38.541946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:38.543207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ca7986e9-7442-44af-9484-5be2e20df418 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.660703 Apr 08 12:16:38.543901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 173/336] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:37 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:38.609288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:38.609970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:38.618613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.619140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:38.620005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.620505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:38.676369 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:38.677149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:38.685300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.685751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:38.686628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.687128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:38.844609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:38.856288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-98ffd11d-1a78-47b1-a0fb-0e1f3e8c87e6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.250921 Apr 08 12:16:38.866421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 164/337] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:38 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:38.866421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:38.866421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:38.870843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.871352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:38.872192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:38.872686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:39.041008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:39.052761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-274ababf-2a59-4f04-9a19-fd07ee8e5875 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.380814 Apr 08 12:16:39.053546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 174/338] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:38 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:39.083480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:39.093593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f6dcafa2-4fb1-48f1-939b-e46d44825bca tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.235504 Apr 08 12:16:39.094240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 165/339] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:38 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:39.238184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:39.238919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:39.247292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:39.247808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:39.248933 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:39.249432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:39.457220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:39.466273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c59b9570-3f63-4121-8652-3359d8082774 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.232718 Apr 08 12:16:39.466951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 175/340] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:39 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:39.563728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:39.564605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:39.572649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:39.573158 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:39.573994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:39.574540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:39.779901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:39.790453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:39.792239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:39.793467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f20fc5fa-ffa0-4a90-b480-3020ad7228c7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.233918 Apr 08 12:16:39.794180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 166/341] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:39 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:39.875375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:39.876072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:39.884901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:39.885412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:39.886245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:39.886769 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.074114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:40.075294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:40.084435 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.085514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.086616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.087310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.112613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:40.123648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-995ea8fd-4d7b-4db6-ab25-9d14a3b8909e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.251976 Apr 08 12:16:40.124302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 176/342] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:39 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:40.136746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:40.136746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:40.139771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.140036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.140902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.141405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.303252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:40.312757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cde1790b-85e9-4e0f-a201-981e7904797e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1502 microversion: 2.1 time: 0.243310 Apr 08 12:16:40.313336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 167/343] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:40 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:40.337443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbf15efd-c608-4a05-be11-a0c412003191"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:40.338778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:40.346903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.347067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:40.347415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.348279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.348771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.357216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2ae5b8ef-6dd0-4e6d-ae27-f3f5668f0df2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.231408 Apr 08 12:16:40.357915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 177/344] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:40 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:40.417058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] HTTP exception thrown: Cannot 'attach_volume' instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 while it is in vm_state rescued Apr 08 12:16:40.417704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Returning 409 to user: Cannot 'attach_volume' instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 while it is in vm_state rescued {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:16:40.418633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-90416535-d4d1-4d8c-8e59-c8e1ec542c18 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.085439 Apr 08 12:16:40.419245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 168/345] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:16:40 2021] POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 08 12:16:40.429096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-51eb1f9c-ad12-46a1-a706-efc2d8f5c961 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:40.429687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-51eb1f9c-ad12-46a1-a706-efc2d8f5c961 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:40.438203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51eb1f9c-ad12-46a1-a706-efc2d8f5c961 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.438768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51eb1f9c-ad12-46a1-a706-efc2d8f5c961 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.440358 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51eb1f9c-ad12-46a1-a706-efc2d8f5c961 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.440866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51eb1f9c-ad12-46a1-a706-efc2d8f5c961 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.485262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:40.490374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:40.494976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.495490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.496343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.496837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.707603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:40.716912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a1d23d5d-1d43-4371-9907-e08436cb9092 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.235838 Apr 08 12:16:40.717534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 169/346] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:40 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:40.730128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-51eb1f9c-ad12-46a1-a706-efc2d8f5c961 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action" status: 202 len: 0 microversion: 2.1 time: 0.304730 Apr 08 12:16:40.731138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 178/347] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:16:40 2021] POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:16:40.740745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:40.741415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:40.750185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.751239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.752223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.752865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.814484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:40.815275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:40.824804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.825325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.826417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:40.826925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:40.969860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:40.980507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-25d48121-36e7-4231-9e9b-661753ed3654 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1510 microversion: 2.1 time: 0.244591 Apr 08 12:16:40.981735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 170/348] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:40 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:41.149076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:41.149990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:41.158813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:41.159450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:41.160518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:41.161099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:41.184747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:41.202149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:41.207661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:41.215901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fb3f2241-cf97-4aa4-8631-8ef1c0c5a69b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.401215 Apr 08 12:16:41.216934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 179/349] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:40 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:41.395269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:41.396044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:41.405227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:41.405718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:41.418813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:41.419453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:41.454217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:41.465455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-110dcfe9-28bb-42fc-8c6f-db06d83ad7d2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.320844 Apr 08 12:16:41.466437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 171/350] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:41 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:41.736006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:41.736631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:41.744745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:41.745277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:41.746086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:41.746631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:41.793437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:41.803855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bf69e4a9-4ba4-4f98-84f9-7b57a281d327 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.427426 Apr 08 12:16:41.804770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 180/351] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:41 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:41.947938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:41.957738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5b4301cc-b60f-4394-8628-7bee2237ddec tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.225878 Apr 08 12:16:41.967826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 172/352] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:41 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:41.999389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:42.000015 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:42.007969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.008485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.009336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.009833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.222505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:42.236207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:42.236884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:42.237650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f564524e-d0df-42a6-9dd7-61f41ea86cb4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1510 microversion: 2.1 time: 0.236443 Apr 08 12:16:42.238485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 181/353] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:41 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:42.244835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.245355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.246209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.246739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.468003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:42.478078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:42.479812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:42.481061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-26d77434-7c72-4fb7-9435-0ff5b886a4b2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.248981 Apr 08 12:16:42.481682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 173/354] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:42 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:42.484721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:42.485389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:42.494256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.494816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.495653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.496149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.698088 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:42.707234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aba2ceb3-4ee8-4eaa-8009-f59b38db42ae tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.226702 Apr 08 12:16:42.707856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 182/355] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:42 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:42.822399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:42.823080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:42.831033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.831550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.832405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.832906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.984592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:42.985683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:42.995557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.996110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:42.996950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:42.997646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.039533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:43.050093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-20f60c16-5e11-41ef-b6a6-d3251aba9337 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.230590 Apr 08 12:16:43.050948 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 174/356] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:42 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:43.256912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:43.257582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:43.265020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:43.266527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:43.271749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.271749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:43.271749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.275007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2a90795e-430a-4b6f-aff8-c12f84468a1d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.294672 Apr 08 12:16:43.275731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 183/357] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:42 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:43.439618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-1086ae10-a627-48e9-a028-7d44ca2075aa req-a516a9a3-4bd7-4198-99df-dc01fcb8bf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537681fb-20cb-416c-8a3a-31a9e4107b84", "name": "network-vif-plugged", "status": "completed", "tag": "64dad50b-c967-4c4a-a35d-db19f3683de0"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:43.441877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:43.441877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:43.454508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1086ae10-a627-48e9-a028-7d44ca2075aa req-a516a9a3-4bd7-4198-99df-dc01fcb8bf0e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:43.455727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1086ae10-a627-48e9-a028-7d44ca2075aa req-a516a9a3-4bd7-4198-99df-dc01fcb8bf0e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.477809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-1086ae10-a627-48e9-a028-7d44ca2075aa req-a516a9a3-4bd7-4198-99df-dc01fcb8bf0e service nova] Creating event network-vif-plugged:64dad50b-c967-4c4a-a35d-db19f3683de0 for instance 537681fb-20cb-416c-8a3a-31a9e4107b84 on hv-cinder-78477 Apr 08 12:16:43.483372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-1086ae10-a627-48e9-a028-7d44ca2075aa req-a516a9a3-4bd7-4198-99df-dc01fcb8bf0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048958 Apr 08 12:16:43.484123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 184/358] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:16:43.504393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:43.509662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:43.510752 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:43.514838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b8cb219e-d4f2-4a7d-bcc7-0d008c0ec417 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1510 microversion: 2.1 time: 0.261617 Apr 08 12:16:43.515473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 175/359] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:43 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:43.520844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:43.521363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.522223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:43.522896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.725520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:43.726336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:43.734163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:43.734698 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.735530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:43.736730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:43.751961 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:43.762781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:43.764636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:43.768583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b7323d9-656f-4b47-bc76-929f740061d6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.262336 Apr 08 12:16:43.768583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 185/360] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:43 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:16:43.937720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:43.946554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f4b0d87c-5866-43ac-a51e-c24574aeb0fb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.224972 Apr 08 12:16:43.947187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 176/361] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:43 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:44.068474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:44.069250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:44.077736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.078239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.079097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.080078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.283454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:44.293290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9b187b5f-cc98-4216-983d-8ef817825d88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.229235 Apr 08 12:16:44.293762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 186/362] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:44 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:44.294817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:44.295649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:44.304827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.305337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.306181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.306707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.525671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:44.534244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:44.534950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:44.536512 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f2230599-80ba-4034-a7fe-69aacd98d409 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.246653 Apr 08 12:16:44.543827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.544350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.545439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.545881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.547274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 177/363] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:44 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:44.752468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:44.761851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4814d4cd-1076-4c62-89d3-ddcc351b2e99 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1516 microversion: 2.1 time: 0.232340 Apr 08 12:16:44.762431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 187/364] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:44 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:44.785838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:44.786659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:44.796060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.797146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.798008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.799112 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.964942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:44.965655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:44.986613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.987215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:44.987986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:44.988491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:45.000323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:45.010830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:45.012717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:45.014128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e8f1b825-df09-4c0e-ac34-970e527956d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.232746 Apr 08 12:16:45.014778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 178/365] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:44 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:45.209127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:45.218487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9b76f580-7c0c-4344-b461-c149046f7cc3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1318 microversion: 2.1 time: 0.257467 Apr 08 12:16:45.219195 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 188/366] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:44 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:45.312165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:45.313027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:45.322045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:45.322965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:45.323825 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:45.324321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:45.552971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-b3c3ffa0-88da-4f82-906d-2f664a041290 req-188a5803-144c-4794-bf93-10b9373bca9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a06df7-1733-495d-aca0-367f3478e75a", "name": "network-vif-plugged", "status": "completed", "tag": "71c435b3-19da-4283-a3b6-0d81d4d1f61d"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:45.555227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:45.555227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:45.572257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-b3c3ffa0-88da-4f82-906d-2f664a041290 req-188a5803-144c-4794-bf93-10b9373bca9f service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:45.572774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-b3c3ffa0-88da-4f82-906d-2f664a041290 req-188a5803-144c-4794-bf93-10b9373bca9f service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:45.592125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-b3c3ffa0-88da-4f82-906d-2f664a041290 req-188a5803-144c-4794-bf93-10b9373bca9f service nova] Creating event network-vif-plugged:71c435b3-19da-4283-a3b6-0d81d4d1f61d for instance e1a06df7-1733-495d-aca0-367f3478e75a on hv-cinder-78477 Apr 08 12:16:45.598561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-b3c3ffa0-88da-4f82-906d-2f664a041290 req-188a5803-144c-4794-bf93-10b9373bca9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050754 Apr 08 12:16:45.599290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 189/367] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:16:45.605419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:45.606192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:45.606333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:45.614986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:45.615509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:45.615997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ea40d738-d241-4b56-9277-069bc56bc33d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.307779 Apr 08 12:16:45.616547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:45.616674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 179/368] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:45 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:45.617370 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:45.825650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:45.836062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3eb32b67-78a4-45e5-b536-a830dadae2a6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.235386 Apr 08 12:16:45.836956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 190/369] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:45 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:46.034106 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:46.034797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:46.043104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.043619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.044459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.044954 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.236675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:46.237342 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:46.242403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:46.245347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.245857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.246735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.247227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.252211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:46.253914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:46.255194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d479946a-aca0-4a98-a59d-8dd9e0833bc3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.225866 Apr 08 12:16:46.255819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 180/370] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:46 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:46.441111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:46.450161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-82900ea6-e5b9-4958-a026-24a764799e93 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1509 microversion: 2.1 time: 0.217554 Apr 08 12:16:46.450841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 191/371] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:46 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:46.612328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-893524216", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:46.640740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:46.640740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:46.643794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.644315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.645161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.645650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.687912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] validate_networks() for None {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:16:46.848741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:46.857254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-89fede4a-d125-4761-a6a9-6138d02c44c8 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.227055 Apr 08 12:16:46.857887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 192/372] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:46 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:46.862701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:46.863367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:46.871326 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.871834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.872686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:46.873444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:46.996162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:16:46.996848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:16:46.997643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:16:47.000739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:16:47.001988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:16:47.015082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.016847 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.018428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.018942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.040306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Getting quotas for project 644c66998a734fa280184ed7a801b8b3. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:16:47.045960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Getting quotas for user c937cddecde5490c842f33afd2bedaa5 and project 644c66998a734fa280184ed7a801b8b3. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:16:47.071449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:16:47.074729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:16:47.144311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:47.153328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d59dcd00-6e03-42d4-aef1-8e5c9d18e057 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1516 microversion: 2.1 time: 0.294336 Apr 08 12:16:47.153954 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 193/373] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:46 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:47.158772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:47.159440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:47.167812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.168329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.169199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.169697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.213345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-60672d2a-71e5-45d5-9a73-c222e1845b42 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605113 Apr 08 12:16:47.214448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 181/374] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:16:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:16:47.219283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1114dd1a-b84c-4a10-8a11-d39caad516bc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39f28de5-b4e6-4024-aa8c-909ee67713ac"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:47.221103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1114dd1a-b84c-4a10-8a11-d39caad516bc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:47.229346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1114dd1a-b84c-4a10-8a11-d39caad516bc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.230133 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1114dd1a-b84c-4a10-8a11-d39caad516bc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.231011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1114dd1a-b84c-4a10-8a11-d39caad516bc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.231511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1114dd1a-b84c-4a10-8a11-d39caad516bc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.409462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:47.427709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f1e3766b-f21a-4f18-b1c6-6ee2d1dd7279 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1314 microversion: 2.1 time: 0.272578 Apr 08 12:16:47.428550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 194/375] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:47 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:47.433198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8a9ca974-7082-48e6-bb6c-9982ed5b71c9 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:47.436651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8a9ca974-7082-48e6-bb6c-9982ed5b71c9 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:47.514214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8a9ca974-7082-48e6-bb6c-9982ed5b71c9 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:47.523111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8a9ca974-7082-48e6-bb6c-9982ed5b71c9 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1214 microversion: 2.1 time: 0.093641 Apr 08 12:16:47.523750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 195/376] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:47 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:47.531203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:47.531863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:47.540299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.540809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.541645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.542135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.738943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:47.758538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:47.758538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:47.758538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d2f7445a-2ba0-4ec8-9c4e-b16023fe70cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.224984 Apr 08 12:16:47.758880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 196/377] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:47 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:47.875979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:47.877524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:47.885442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.885963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:47.886849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:47.887351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.043257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1114dd1a-b84c-4a10-8a11-d39caad516bc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827382 Apr 08 12:16:48.043956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 182/378] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:16:47 2021] POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:48.171808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ccefba22-8b0a-485d-b2a0-ee4c343b785e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ca6c0cc-6420-469f-b4a9-6b3a7bd3cc1e"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:48.173999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ccefba22-8b0a-485d-b2a0-ee4c343b785e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:48.186032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccefba22-8b0a-485d-b2a0-ee4c343b785e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.186565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccefba22-8b0a-485d-b2a0-ee4c343b785e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.195271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccefba22-8b0a-485d-b2a0-ee4c343b785e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.196469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccefba22-8b0a-485d-b2a0-ee4c343b785e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.294018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:48.305772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fc3a2d20-ce12-48f3-9010-1f52b273d46e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.434033 Apr 08 12:16:48.306580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 197/379] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:47 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:48.450063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:48.450063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:48.458043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.458825 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.459871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.460537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.682866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:48.692571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bce16ff0-ce93-41bb-b322-a9639ac97b0a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1498 microversion: 2.1 time: 0.250878 Apr 08 12:16:48.694036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 198/380] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:48 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:48.699419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:48.700497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:48.711002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.711841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.713602 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.714250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.847599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:48.856846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-81af5b52-4106-46c8-b77b-0eabd87880ad tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1210 microversion: 2.1 time: 0.161384 Apr 08 12:16:48.857515 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 199/381] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:48 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:48.862276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:48.862957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:48.870878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.871416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:48.872294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:48.872785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:49.078042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:49.088686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:49.090641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:49.091971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-294c37fc-a381-4cfe-907f-6148bd553c6a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.233453 Apr 08 12:16:49.092620 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 200/382] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:48 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:49.100640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ccefba22-8b0a-485d-b2a0-ee4c343b785e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "POST /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.933054 Apr 08 12:16:49.101280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 183/383] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:16:48 2021] POST /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84/os-volume_attachments => generated 194 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:16:49.323702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:49.324368 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:49.332466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:49.332975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:49.333802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:49.334292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:49.759734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:49.769430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-931c0a46-f6fa-443d-b9c5-2da6777a1e58 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.449547 Apr 08 12:16:49.779833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 201/384] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:49 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:49.878285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:49.879083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:49.888695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:49.889451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:49.890669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:49.891372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.049186 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:50.061824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-25473bdd-c1fa-498a-ba91-3a8759a43b3f tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1284 microversion: 2.1 time: 0.188323 Apr 08 12:16:50.063347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 184/385] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:49 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:50.116661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:50.116661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:50.125940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.126758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.127836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.128523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.227632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:50.228171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:50.237296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.238763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.238763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.239135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.307784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:16:50.389813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:50.400927 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:50.402874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:50.406461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b2ec398f-884a-46a2-89da-1fa1fc2812e6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.298829 Apr 08 12:16:50.407254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 202/386] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:50 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:50.674182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-57abecd2-377e-4371-8999-c604fa67fa9b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 204 len: 0 microversion: 2.1 time: 0.449418 Apr 08 12:16:50.675417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 185/387] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:16:50 2021] DELETE /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:16:50.683643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:50.684297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:50.693883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.694435 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.695456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.696277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.788188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:50.789067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:50.797756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.799000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:50.800237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:50.800827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:51.006871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:51.016971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-085572b4-9b68-4d88-84c5-f4be97dd7f12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.233292 Apr 08 12:16:51.017841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 186/388] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:50 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:51.080683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:51.081359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:51.082112 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:51.090345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:51.090618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:51.091511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-816f9854-4e2d-4055-9a30-b817c6bdddf4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1504 microversion: 2.1 time: 0.411758 Apr 08 12:16:51.091756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:51.092125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 203/389] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:50 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1504 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:51.092258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:51.323380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:51.332341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-99fcb515-768e-4174-a53f-f1172fa40028 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.255954 Apr 08 12:16:51.332974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 187/390] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:51 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:51.433372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:51.434032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:51.442262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:51.443033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:51.443897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:51.444395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:51.716433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:51.740547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:51.750244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:51.752271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ed8f7836-88cb-44b2-9305-d686728f2836 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.323021 Apr 08 12:16:51.753725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 204/391] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:51 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:52.035193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:52.035873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:52.044315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.044775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:52.045684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.046187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:52.112018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:52.114286 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:52.122956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.123995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:52.125075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.125929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:52.255254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:52.264851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1153c33c-2cf5-4aad-a63f-ea0264948151 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.233791 Apr 08 12:16:52.265482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 188/392] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:52 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:52.350715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:52.351381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:52.359171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.359682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:52.361044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.361545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:52.487814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:52.497171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-37c184bc-ea1e-41a2-b40c-dce1ec3a741e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1504 microversion: 2.1 time: 0.390310 Apr 08 12:16:52.497883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 205/393] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:52 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:52.574087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:52.584761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e014fd58-9436-4322-97c9-1c65703d447d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.238057 Apr 08 12:16:52.585580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 189/394] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:52 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:52.772560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:52.773333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:52.781323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.781924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:52.783047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:52.783629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.227245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-711f29a1-c0df-4f7a-8a71-3207f6da1a10 req-750f2232-f376-4898-ab32-57334e145345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102f4898-dfed-4abd-80c8-dcd8003a1545", "tag": "4faa425e-67c8-4be1-b9e2-2db846adae71"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:53.229108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:53.229108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:53.239001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-711f29a1-c0df-4f7a-8a71-3207f6da1a10 req-750f2232-f376-4898-ab32-57334e145345 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:53.239519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-711f29a1-c0df-4f7a-8a71-3207f6da1a10 req-750f2232-f376-4898-ab32-57334e145345 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.258854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-711f29a1-c0df-4f7a-8a71-3207f6da1a10 req-750f2232-f376-4898-ab32-57334e145345 service nova] Creating event network-changed:4faa425e-67c8-4be1-b9e2-2db846adae71 for instance 102f4898-dfed-4abd-80c8-dcd8003a1545 on hv-cinder-78477 Apr 08 12:16:53.264183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-711f29a1-c0df-4f7a-8a71-3207f6da1a10 req-750f2232-f376-4898-ab32-57334e145345 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040788 Apr 08 12:16:53.265032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 190/395] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:16:53.271491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:53.281748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:53.284207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:53.284638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:53.285476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:53.285592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8ec0a352-9f6e-4d18-b1a6-d0d24d7b42cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1744 microversion: 2.20 time: 0.517077 Apr 08 12:16:53.293846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:53.294353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.295285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:53.295781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.297443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 206/396] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:52 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1744 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:53.499237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:53.508939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f802169a-1b86-4fcb-a300-397de31954c4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.229950 Apr 08 12:16:53.509564 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 191/397] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:53 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:53.516045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:53.516887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:53.524889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:53.525402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.526239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:53.526764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.603137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:53.603856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:53.612660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:53.613269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.614247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:53.614782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:53.723051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:53.731832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ee82fc15-ff55-4d69-aaec-ad34b5e1e40d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1504 microversion: 2.1 time: 0.219953 Apr 08 12:16:53.732446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 207/398] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:53 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:53.808845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:53.817763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7fd59927-b8c2-4554-977f-de9e4d005da3 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.219070 Apr 08 12:16:53.818418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 192/399] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:53 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:54.304968 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:54.305627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:54.314546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.315088 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.315943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.316469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.515056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:54.525101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:54.526810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:54.528001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:54.528125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6cb0e5c9-e55e-4932-8b03-9409e2f4daed tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1744 microversion: 2.20 time: 0.227150 Apr 08 12:16:54.528610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 208/400] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:54 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:54.528890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:54.537464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.537964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.538837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.539336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.734735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:54.744261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3bf45adc-f35a-4025-b454-beb214609b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.220456 Apr 08 12:16:54.745039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 193/401] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:54 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:54.750756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:54.751650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:54.759563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.760068 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.760895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.761383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.836436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:54.837235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:54.845099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.845609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.846512 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:54.847012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:54.957795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:54.967009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59c3866f-0bd7-4aef-86aa-510e924c1e1e tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1504 microversion: 2.1 time: 0.220570 Apr 08 12:16:54.967630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 209/402] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:54 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:55.040416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:55.049165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-90aded22-afa3-463e-88ec-b8f1e7075103 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.216775 Apr 08 12:16:55.049780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 194/403] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:54 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:16:55.547583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:55.549028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:55.557065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:55.557652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:55.558453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:55.558952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:55.763271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:55.764062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:55.773655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:55.774288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:55.775282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:55.775910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:56.075458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:56.088520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:56.090748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:56.092215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8e3c0670-a1ce-405c-98ff-b16b79a54d53 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1744 microversion: 2.20 time: 0.548864 Apr 08 12:16:56.093325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 210/404] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:55 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1744 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:56.099072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:56.100132 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:56.109980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:56.111611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:56.113306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:56.114049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:56.183763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:56.194647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1f3c1617-a492-4ee7-a29f-7204fa074a30 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.435599 Apr 08 12:16:56.195509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 195/405] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:55 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:56.210105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:56.210816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:56.242284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:56.243037 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:56.244124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:56.244817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:56.573776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:56.588477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4b47f285-e229-46f3-b45e-a874c43a4cb4 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1504 microversion: 2.1 time: 0.493770 Apr 08 12:16:56.599125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 211/406] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:56 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:56.981444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:56.981444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a6439a83-5cff-4235-bb67-545ccc321d59 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.770917 Apr 08 12:16:56.981444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 196/407] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:56 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:57.113251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:57.113911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:57.122203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.122744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.123839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.124332 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.214079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:57.214783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:57.225324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.225843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.226719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.227218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.327569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:57.339171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:57.341064 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:57.342545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6661ed75-5359-4ba5-b36f-540c7cf2db8a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1744 microversion: 2.20 time: 0.234062 Apr 08 12:16:57.343340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 212/408] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:57 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1744 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:57.490101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-e0666167-acf2-47f4-a624-76ddb7784a2d req-34309af3-f79c-4eaa-bab5-8dc409fc2d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704586d7-ad35-414f-af0c-5835b542f260", "name": "network-vif-plugged", "status": "completed", "tag": "53f6e72e-034c-4c1c-be6e-8d0a69255cf0"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:57.492586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:57.492586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:57.503254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e0666167-acf2-47f4-a624-76ddb7784a2d req-34309af3-f79c-4eaa-bab5-8dc409fc2d49 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.503857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e0666167-acf2-47f4-a624-76ddb7784a2d req-34309af3-f79c-4eaa-bab5-8dc409fc2d49 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.525394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-e0666167-acf2-47f4-a624-76ddb7784a2d req-34309af3-f79c-4eaa-bab5-8dc409fc2d49 service nova] Creating event network-vif-plugged:53f6e72e-034c-4c1c-be6e-8d0a69255cf0 for instance 704586d7-ad35-414f-af0c-5835b542f260 on hv-cinder-78477 Apr 08 12:16:57.530958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-e0666167-acf2-47f4-a624-76ddb7784a2d req-34309af3-f79c-4eaa-bab5-8dc409fc2d49 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046143 Apr 08 12:16:57.531779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 213/409] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:16:57.555297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:57.567220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b58f75e-4304-40ee-9c15-3008bec2da2a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.358216 Apr 08 12:16:57.569318 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 197/410] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:57 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:57.610744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:57.612224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:57.630263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.630725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.631608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.632155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.653766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d1830c8f-fabf-4206-a2f2-dba94b60dafe req-26875fd7-594d-4be3-998b-c0f733f148c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a06df7-1733-495d-aca0-367f3478e75a", "name": "network-vif-deleted", "tag": "71c435b3-19da-4283-a3b6-0d81d4d1f61d"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:57.656049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:16:57.656049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:16:57.665873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d1830c8f-fabf-4206-a2f2-dba94b60dafe req-26875fd7-594d-4be3-998b-c0f733f148c4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:57.666479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d1830c8f-fabf-4206-a2f2-dba94b60dafe req-26875fd7-594d-4be3-998b-c0f733f148c4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:57.684742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d1830c8f-fabf-4206-a2f2-dba94b60dafe req-26875fd7-594d-4be3-998b-c0f733f148c4 service nova] Creating event network-vif-deleted:71c435b3-19da-4283-a3b6-0d81d4d1f61d for instance e1a06df7-1733-495d-aca0-367f3478e75a on hv-cinder-78477 Apr 08 12:16:57.691089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d1830c8f-fabf-4206-a2f2-dba94b60dafe req-26875fd7-594d-4be3-998b-c0f733f148c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042195 Apr 08 12:16:57.693148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 198/411] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:16:57.781168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:57.791266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0ec45dd3-508f-490c-85ec-7b48e6598acb tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 200 len: 1462 microversion: 2.1 time: 0.185538 Apr 08 12:16:57.792110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 214/412] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:57 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 1462 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:57.995852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:57.996608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:58.005606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.006125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.007000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.007601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.218812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:58.228132 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-17e2a729-99f6-4bb6-bf10-46d04066f10d tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.236904 Apr 08 12:16:58.229473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 199/413] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:57 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:58.362241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:58.363049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:58.371557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.372083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.372946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.373697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.586653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:58.587337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:58.600881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.606025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.606025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.606025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.655473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:58.690818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:58.692488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:58.693719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e44d08b4-cf68-42a0-a3d4-25c8f26203da tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.336673 Apr 08 12:16:58.694347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 215/414] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:58 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:16:58.809406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:58.810582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: e1a06df7-1733-495d-aca0-367f3478e75a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:58.821797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.822601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.823760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:58.824538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:58.889572 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] HTTP exception thrown: Instance e1a06df7-1733-495d-aca0-367f3478e75a could not be found. Apr 08 12:16:58.890574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Returning 404 to user: Instance e1a06df7-1733-495d-aca0-367f3478e75a could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:16:58.891180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8ebf250d-44d4-498d-855e-11aa0121fa98 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a" status: 404 len: 111 microversion: 2.1 time: 0.085847 Apr 08 12:16:58.895830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 216/415] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:58 2021] GET /compute/v2.1/servers/e1a06df7-1733-495d-aca0-367f3478e75a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:16:58.908960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:58.921759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e3b8098f-b4be-49dd-9469-c1e245b9a058 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.339850 Apr 08 12:16:58.923532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 200/416] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:58 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:59.027986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-174465368", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "e78474b0-0267-4206-95c8-f7e7d8afada8"}]}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:16:59.103334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] validate_networks() for [('e78474b0-0267-4206-95c8-f7e7d8afada8', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:16:59.248466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:59.249137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:59.260045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:59.263919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:59.263919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:59.263919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:59.649341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:16:59.667781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-57190ae3-d673-424b-900e-e8a20d29c449 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.423511 Apr 08 12:16:59.668793 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 201/417] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:16:59 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:16:59.715097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:16:59.716122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:16:59.726233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:59.727061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:59.728138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:59.728839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:59.810090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:16:59.810614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:16:59.811169 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:16:59.811711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:16:59.812346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:16:59.839711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:59.840235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:59.841142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:16:59.841638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:16:59.884608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Getting quotas for project 59af83a5bec643c1bf2d8a3ede4b9a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:16:59.893268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Getting quotas for user f3786ec5feb8460da013a34f428b22f0 and project 59af83a5bec643c1bf2d8a3ede4b9a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:16:59.916534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:16:59.925728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:16:59.996175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:00.007180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:00.009157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:00.010482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d2821c7c-ad83-4571-a9e0-15ccd0721176 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.301237 Apr 08 12:17:00.011100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 202/418] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:16:59 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:00.016041 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:00.016747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:00.025875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:00.026435 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:00.027415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:00.027808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:00.041729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-84a3f5e4-4acc-4e78-a48e-f7c0fa453a18 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018137 Apr 08 12:17:00.047792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 217/419] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:16:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:17:00.056563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-de4d7f59-fdbf-462c-b41f-e7ee779bfdcf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:00.058808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-de4d7f59-fdbf-462c-b41f-e7ee779bfdcf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:00.210531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-de4d7f59-fdbf-462c-b41f-e7ee779bfdcf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:00.219327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-de4d7f59-fdbf-462c-b41f-e7ee779bfdcf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1213 microversion: 2.1 time: 0.167903 Apr 08 12:17:00.220514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 218/420] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:00 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:00.314076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:00.325064 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-871064db-d674-44cf-9eaa-7b427f09af38 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.312656 Apr 08 12:17:00.325846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 203/421] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:00 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:00.697211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:00.698597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:00.707163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:00.718121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:00.727316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:00.728032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:01.030691 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:01.031748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:01.041549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:01.042818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:01.043604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:01.044294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:01.218456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:01.243752 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c408cc44-3126-4178-ab06-d21d53f9f9b8 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.560320 Apr 08 12:17:01.247460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 219/422] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:00 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:01.259241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:01.260522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:01.269614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:01.270700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:01.283659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:01.286823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:01.320686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:01.334114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:01.336139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:01.339419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5367a1aa-9a68-4ebd-8080-0d7276a09f19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.311762 Apr 08 12:17:01.340480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 204/423] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:01 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:01.346641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:01.347565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:01.356410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:01.357217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:01.358287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:01.359031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:01.548541 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:01.561085 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e53343b0-29d7-4fe3-acc3-3486d41d8bb1 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1209 microversion: 2.1 time: 0.308566 Apr 08 12:17:01.562325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 220/424] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:01 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1209 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:01.640081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:01.651607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b51b3e14-3521-4710-832d-1453c9a6cabc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.309538 Apr 08 12:17:01.652913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 205/425] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:01 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:02.265561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:02.266244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:02.275391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.275914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.276789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.277291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.365869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:02.518686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:02.518686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.518686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.518686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.519279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.519384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:02.519384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-29eb4641-aa33-455d-91f6-42a4b2be9c4c tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.237105 Apr 08 12:17:02.519384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 221/426] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:02 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:02.581553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:02.582224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:02.590501 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.591020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.591949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.592450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.610424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:02.620320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:02.621993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:02.623493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-efa5ca29-491a-411d-b92a-07d6cc981b5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.261450 Apr 08 12:17:02.624099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 206/427] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:02 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:02.671971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:02.673945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:02.686097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.686097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.686097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:02.686097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:02.869458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:02.881738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-db42550c-9bce-4d99-a594-f73ec2c708ac tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1273 microversion: 2.1 time: 0.305032 Apr 08 12:17:02.882756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 222/428] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:02 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:03.197857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:03.214610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9090e5c6-f8ab-4c84-a3cb-2d5dd0268c76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.546827 Apr 08 12:17:03.216317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 207/429] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:02 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:03.534023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:03.534743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:03.546032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:03.546766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:03.547858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:03.548585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:03.645809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:03.660059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:03.686995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:03.687676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:03.688787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:03.689437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:03.981278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:03.992309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-45a5101b-5fa9-4e1e-8b9b-cba03b43699e tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.462137 Apr 08 12:17:03.993272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 223/430] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:03 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:03.999373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:04.000502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:04.008796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:04.009298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:04.010156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:04.010682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:04.115425 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:04.141203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:04.154659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:04.155883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-50983505-e0e6-462e-b625-a6f47cf7225f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.515761 Apr 08 12:17:04.156672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 208/431] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:03 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:04.239475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:04.240458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:04.264243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:04.264770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:04.265649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:04.266152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:04.281790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:04.295226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-48524614-b19b-4520-8bfb-e68c9e575f14 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1271 microversion: 2.1 time: 0.300599 Apr 08 12:17:04.296220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 224/432] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:03 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:04.779477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:04.790318 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4f2ffed7-0e78-4e05-aab6-c089070e32db tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.556448 Apr 08 12:17:04.790941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 209/433] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:04 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:05.013577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:05.014167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:05.023071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.023590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.024440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.024938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.176650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:05.177585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:05.193874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.194490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.195298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.195799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.300437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:05.315043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f7ccaa74-e5ae-4e87-8e06-d674304fe655 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.305702 Apr 08 12:17:05.318382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 225/434] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:05 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:05.329822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:05.330817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:05.355212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.356387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.359626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.360384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.695019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:05.705507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-80c45ead-2597-4c99-ad02-37a0ddd0168f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.385702 Apr 08 12:17:05.706163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 226/435] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:05 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:05.711616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-463b662c-57d7-4162-9adc-3e82a90145fc req-ec854e10-4043-4f40-95ac-20274645e276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102f4898-dfed-4abd-80c8-dcd8003a1545", "name": "network-vif-plugged", "status": "completed", "tag": "4faa425e-67c8-4be1-b9e2-2db846adae71"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:05.713422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:05.713422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:05.732957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-463b662c-57d7-4162-9adc-3e82a90145fc req-ec854e10-4043-4f40-95ac-20274645e276 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.733459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-463b662c-57d7-4162-9adc-3e82a90145fc req-ec854e10-4043-4f40-95ac-20274645e276 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.766155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-463b662c-57d7-4162-9adc-3e82a90145fc req-ec854e10-4043-4f40-95ac-20274645e276 service nova] Creating event network-vif-plugged:4faa425e-67c8-4be1-b9e2-2db846adae71 for instance 102f4898-dfed-4abd-80c8-dcd8003a1545 on hv-cinder-78477 Apr 08 12:17:05.773359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-463b662c-57d7-4162-9adc-3e82a90145fc req-ec854e10-4043-4f40-95ac-20274645e276 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065724 Apr 08 12:17:05.774128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 227/436] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:17:05.829418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:05.835944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:05.879734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.881610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:05.882918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.887789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:05.893094 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:05.894245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:05.897872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:05.899200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c3d8bd4f-5239-4021-90a4-ca86440a400a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.727967 Apr 08 12:17:05.930343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 210/437] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:05 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:06.322573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:06.336415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2e47d029-5a45-43c8-a472-a5fac19f1ab5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.526298 Apr 08 12:17:06.336914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:06.337673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:06.346698 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:06.347323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 228/438] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:05 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:06.347453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:06.348425 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:06.348973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:06.694907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:06.703644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-da75c5a0-edb1-4dd7-9c94-eb7f92714bba tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1314 microversion: 2.1 time: 0.371226 Apr 08 12:17:06.704838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 211/439] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:06 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:06.723677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:06.724342 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:06.732345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:06.732859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:06.733697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:06.734192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:06.929556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:06.930268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:06.939618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:06.940461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:06.941451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:06.942124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:07.300731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:07.311816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fd90fd96-28c7-479a-840b-1f11ae905fe7 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.593162 Apr 08 12:17:07.312461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 229/440] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:06 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:07.355991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:07.356683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:07.369438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:07.369438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:07.369438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:07.369438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:07.580754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:07.592287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:07.594331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:07.596012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ac49771d-5682-4393-ae82-4e1b097c6ca9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.670675 Apr 08 12:17:07.597265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 212/441] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:06 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:07.602230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d94debcb-0adf-4af0-a2dd-8e909b4069e5 req-556f4ca1-86a9-4472-b8e6-b5ede527a13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d60c14-af1c-4517-b5c6-7f606012724c", "tag": "2a5f01f5-e80b-48ac-af81-19fbc5df5c69"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:07.604261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:07.604261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:07.617882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d94debcb-0adf-4af0-a2dd-8e909b4069e5 req-556f4ca1-86a9-4472-b8e6-b5ede527a13a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:07.618695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d94debcb-0adf-4af0-a2dd-8e909b4069e5 req-556f4ca1-86a9-4472-b8e6-b5ede527a13a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:07.638722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d94debcb-0adf-4af0-a2dd-8e909b4069e5 req-556f4ca1-86a9-4472-b8e6-b5ede527a13a service nova] Creating event network-changed:2a5f01f5-e80b-48ac-af81-19fbc5df5c69 for instance 51d60c14-af1c-4517-b5c6-7f606012724c on hv-cinder-78477 Apr 08 12:17:07.651995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d94debcb-0adf-4af0-a2dd-8e909b4069e5 req-556f4ca1-86a9-4472-b8e6-b5ede527a13a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053216 Apr 08 12:17:07.653780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 213/442] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:17:07.667715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:07.678804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e7c8faf6-9ace-47b5-9fb3-7dcc265b6c57 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1722 microversion: 2.1 time: 0.327284 Apr 08 12:17:07.679014 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 230/443] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:07 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:07.722490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:07.723494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:07.732091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:07.732839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:07.733859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:07.734604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.041171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:08.043239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:08.052317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.053481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.054566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.055288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.147315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lazy-loading 'flavor' on Instance uuid d63b515b-cd97-4a20-a16f-7b1f3eba4460 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:17:08.211524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:08.235193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d96b573a-0159-4a07-85c5-c0ffc3805552 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1464 microversion: 2.1 time: 0.509370 Apr 08 12:17:08.237818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 214/444] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:07 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1464 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:08.330786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:08.331584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:08.350461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.351019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.351986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.352496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.564114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b7e3f143-515b-4521-9193-811ccd68c049 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action" status: 200 len: 32 microversion: 2.1 time: 0.528587 Apr 08 12:17:08.565955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 231/445] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:17:08 2021] POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action => generated 32 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:17:08.575278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:08.581924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:08.597729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.599121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.599703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.600372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.682257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:17:08.924783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2a6e5773-6c2c-4d88-9daf-e738193cae62 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "DELETE /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 204 len: 0 microversion: 2.1 time: 0.356992 Apr 08 12:17:08.925810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 232/446] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:17:08 2021] DELETE /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:17:08.932190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:08.933895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:08.946582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.953261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.954317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:08.954908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:08.976982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:08.994964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9cbb9ec4-df4c-4603-9f40-68045b89e22d tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.665954 Apr 08 12:17:08.996134 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 215/447] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:08 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:09.004105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:09.007255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:09.024685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:09.028119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:09.029477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:09.030490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:09.522738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:09.538762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:09.540461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:09.541734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2f60a074-388b-4e4c-a082-0b4741e9683a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.544387 Apr 08 12:17:09.549279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 216/448] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:08 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:09.559064 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:09.559737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:09.573209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:09.573839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:09.575339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:09.575841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:09.887669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:09.898378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-94abb523-d180-467e-a042-6994a43936fa tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.971019 Apr 08 12:17:09.909932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 233/449] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:08 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:09.909932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:09.909932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:09.917932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:09.918817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:09.924244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:09.925107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:09.974813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:09.989107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-48ad8ed6-b70d-4c93-b73d-a2c172e9a2eb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1699 microversion: 2.1 time: 0.438413 Apr 08 12:17:09.990099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 217/450] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:09 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1699 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:10.010508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d400301f-6943-4dea-8e27-92dbe66b1f07 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:10.031309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d400301f-6943-4dea-8e27-92dbe66b1f07 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.035555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d400301f-6943-4dea-8e27-92dbe66b1f07 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.122644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d400301f-6943-4dea-8e27-92dbe66b1f07 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Going to try to start instance {{(pid=98474) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 08 12:17:10.231511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:10.241595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b4f312f-a9fa-4da5-bd32-058fb83bf465 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1470 microversion: 2.1 time: 0.340882 Apr 08 12:17:10.242230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 234/451] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:09 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:10.246935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:10.247602 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:10.256614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.257434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.258036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.258471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.303591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d400301f-6943-4dea-8e27-92dbe66b1f07 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 202 len: 0 microversion: 2.1 time: 0.298470 Apr 08 12:17:10.305021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 218/452] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:17:10 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:17:10.325361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:10.326142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:10.335928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.336448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.337310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.337888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.541737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:10.552207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e377c22e-e85f-40c9-a84d-c0aed0a3ae12 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.308806 Apr 08 12:17:10.553461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 235/453] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:10 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:10.566977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:10.567755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:10.576145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.576753 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.577687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.578258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.660367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:10.674394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0101009e-2efe-404d-be6e-5e01556149c7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1708 microversion: 2.1 time: 0.364423 Apr 08 12:17:10.675033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 219/454] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:10 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1708 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:10.852680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:10.867032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:10.868721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:10.870038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-434778a5-eea7-4962-8895-2fe3767b7a6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.312077 Apr 08 12:17:10.870688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 236/455] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:10 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:10.917362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:10.918433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:10.927376 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.928272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:10.929333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:10.930050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:11.260754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:11.261428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:11.273534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:11.274058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:11.275076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:11.275584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:11.506979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:11.516720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cbc2b387-ef95-4248-9371-ebfad7d4e7e1 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.603321 Apr 08 12:17:11.518115 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 220/456] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:10 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:11.571316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:11.572065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:11.580683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:11.581290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:11.582357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:11.583544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:11.725760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:11.741003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-763a3924-8824-48cf-90f3-f4f245bcff1b tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1470 microversion: 2.1 time: 0.484123 Apr 08 12:17:11.748837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 237/457] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:11 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1470 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:11.755944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:11.757048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:11.770168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:11.771044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:11.772808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:11.773669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:11.985752 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:12.003021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-66f5b932-4a20-41a7-95a1-f60338a35753 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.433640 Apr 08 12:17:12.003871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 221/458] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:11 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:12.020956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:12.022438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:12.044980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:12.045906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:12.046917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:12.047540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:12.232010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:12.247693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c3661f66-ece3-4222-aa6a-57586e9421d7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1708 microversion: 2.1 time: 0.497031 Apr 08 12:17:12.261848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 238/459] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:11 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1708 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:12.287399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:12.298762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:12.300457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:12.301867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c0b3ae0e-350c-4bc7-bc2c-cd8363b03463 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.286554 Apr 08 12:17:12.302525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 222/460] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:12 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:12.535737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:12.536449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:12.544330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:12.544846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:12.545691 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:12.546191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:12.736699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-cd4a87ab-b53c-42e1-8668-2e41e930aa87 req-08858445-fb7b-4203-9a6b-b265d642e4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102f4898-dfed-4abd-80c8-dcd8003a1545", "name": "network-vif-deleted", "tag": "4faa425e-67c8-4be1-b9e2-2db846adae71"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:12.738802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:12.738802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:12.747783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-cd4a87ab-b53c-42e1-8668-2e41e930aa87 req-08858445-fb7b-4203-9a6b-b265d642e4d5 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:12.749697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-cd4a87ab-b53c-42e1-8668-2e41e930aa87 req-08858445-fb7b-4203-9a6b-b265d642e4d5 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:12.767855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-cd4a87ab-b53c-42e1-8668-2e41e930aa87 req-08858445-fb7b-4203-9a6b-b265d642e4d5 service nova] Creating event network-vif-deleted:4faa425e-67c8-4be1-b9e2-2db846adae71 for instance 102f4898-dfed-4abd-80c8-dcd8003a1545 on hv-cinder-78477 Apr 08 12:17:12.773231 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-cd4a87ab-b53c-42e1-8668-2e41e930aa87 req-08858445-fb7b-4203-9a6b-b265d642e4d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042290 Apr 08 12:17:12.774164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 223/461] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:17:12.779422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:12.780194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:12.789272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:12.789796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:12.790792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:12.791299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:12.814998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:12.826165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ef968f4a-66e1-47ea-810c-dba79da84cd5 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.294411 Apr 08 12:17:12.826913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 239/462] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:12 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:12.940602 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c937cddecde5490c842f33afd2bedaa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644c66998a734fa280184ed7a801b8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:12.949735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2941a2ae-ddb5-48ae-9f0e-76b8b7fec899 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 200 len: 1299 microversion: 2.1 time: 0.174492 Apr 08 12:17:12.950721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 224/463] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:12 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:13.022153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:13.022882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:13.031611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.032404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.034639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.035221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.241411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:13.250551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-73ae5fb1-0c4a-46f6-8538-5fe2766516b5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.232960 Apr 08 12:17:13.251189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 240/464] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:13 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:13.267000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:13.268287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:13.276308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.276775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.277668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.278168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.321374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:13.322047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:13.330599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.331117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.331957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.332451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.492099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:13.505277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e2952209-a35c-4de1-8d1e-f71b10d73ef4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1712 microversion: 2.1 time: 0.242243 Apr 08 12:17:13.506009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 225/465] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:13 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1712 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:13.569853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:13.579615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:13.582113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:13.583390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8025786d-c0f7-4a55-843e-e8ae72f17ffe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1739 microversion: 2.20 time: 0.266096 Apr 08 12:17:13.584198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 241/466] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:13 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:13.844410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:13.845073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:13.853389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.853915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.854774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.855265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.968418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:13.969321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] [instance: 102f4898-dfed-4abd-80c8-dcd8003a1545] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:13.977588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.978362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:13.979390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:13.980046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:14.042469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] HTTP exception thrown: Instance 102f4898-dfed-4abd-80c8-dcd8003a1545 could not be found. Apr 08 12:17:14.043184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] Returning 404 to user: Instance 102f4898-dfed-4abd-80c8-dcd8003a1545 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:17:14.044135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a83fbe0f-5390-4aeb-8406-0a166307fa18 tempest-VolumesNegativeTest-760580095 tempest-VolumesNegativeTest-760580095-project] 10.222.0.43 "GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545" status: 404 len: 111 microversion: 2.1 time: 0.079839 Apr 08 12:17:14.052207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 242/467] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:13 2021] GET /compute/v2.1/servers/102f4898-dfed-4abd-80c8-dcd8003a1545 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:17:14.080364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:14.090079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e2360ab4-d910-4faa-b69a-9cff4cdfa441 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.249714 Apr 08 12:17:14.090745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 226/468] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:13 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:14.269314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:14.270146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:14.281891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:14.282428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:14.295189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:14.295751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:14.602732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:14.603492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:14.611998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:14.612588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:14.613510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:14.614074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:14.666950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:14.688262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ad2c0511-2435-49e5-aac6-15cb4dc34a8b tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.423337 Apr 08 12:17:14.689467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 243/469] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:14 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:14.820340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:14.830526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:14.832149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:14.833382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f475f1a0-ab1b-4b38-b708-08f9fec5e455 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1721 microversion: 2.20 time: 0.234896 Apr 08 12:17:14.834285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 227/470] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:14 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:15.113899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:15.114721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:15.123079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.124011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:15.124854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.125340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:15.333674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:15.343894 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5086125b-e748-43d1-9e49-c5e44f3265ae tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.235145 Apr 08 12:17:15.344421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 244/471] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:15 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:15.708796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:15.709699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:15.718590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.719433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:15.720458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.721484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:15.853666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:15.854572 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:15.866750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.867280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:15.868137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.868634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:15.937046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:15.946872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a3af1610-e537-4b55-a21e-b610f192d708 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.242105 Apr 08 12:17:15.947486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 228/472] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:15 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:15.970842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:15.971394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:15.979496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.980008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:15.980847 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:15.981342 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:16.073718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:16.084262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:16.086492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:16.087725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-55e1fec4-511d-4739-8428-951887df32fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1721 microversion: 2.20 time: 0.238690 Apr 08 12:17:16.088559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 245/473] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:15 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:16.163646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lazy-loading 'services' on Instance uuid 537681fb-20cb-416c-8a3a-31a9e4107b84 {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:17:16.361993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:16.362647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:16.363503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-70a04691-76ff-4eee-bcd3-4ac4361fa5e3 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84/os-volume_attachments/2ca6c0cc-6420-469f-b4a9-6b3a7bd3cc1e" status: 202 len: 0 microversion: 2.1 time: 0.396553 Apr 08 12:17:16.364167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 229/474] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:17:15 2021] DELETE /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84/os-volume_attachments/2ca6c0cc-6420-469f-b4a9-6b3a7bd3cc1e => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:17:16.371253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:16.371911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:16.372781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:16.373533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:16.600789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:16.610526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-18726199-ee15-465e-8f6d-7e5943bdce83 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.253457 Apr 08 12:17:16.611755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 246/475] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:16 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:16.965749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:16.966571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:16.975664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:16.976199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:16.977057 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:16.977569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:17.107408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:17.108080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:17.116263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:17.117012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:17.117866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:17.118408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:17.184123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:17.193531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-655f491d-6ee5-4532-a195-3aaec54c9e0f tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.232260 Apr 08 12:17:17.194445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 230/476] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:16 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:17.337242 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:17.348864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:17.350685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:17.352127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0ced3a6e-4a9a-4f92-975e-e040a3da5a96 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1721 microversion: 2.20 time: 0.249174 Apr 08 12:17:17.352857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 247/477] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:17 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:17.573246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-88f1349f-3214-4fe5-9934-219c88f72e05 req-7d821169-e6a6-430f-9154-a8bf2f9307c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d60c14-af1c-4517-b5c6-7f606012724c", "name": "network-vif-plugged", "status": "completed", "tag": "2a5f01f5-e80b-48ac-af81-19fbc5df5c69"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:17.575292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:17.575292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:17.584808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-88f1349f-3214-4fe5-9934-219c88f72e05 req-7d821169-e6a6-430f-9154-a8bf2f9307c2 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:17.585299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-88f1349f-3214-4fe5-9934-219c88f72e05 req-7d821169-e6a6-430f-9154-a8bf2f9307c2 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:17.608635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-88f1349f-3214-4fe5-9934-219c88f72e05 req-7d821169-e6a6-430f-9154-a8bf2f9307c2 service nova] Creating event network-vif-plugged:2a5f01f5-e80b-48ac-af81-19fbc5df5c69 for instance 51d60c14-af1c-4517-b5c6-7f606012724c on hv-cinder-78477 Apr 08 12:17:17.614327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-88f1349f-3214-4fe5-9934-219c88f72e05 req-7d821169-e6a6-430f-9154-a8bf2f9307c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045372 Apr 08 12:17:17.615526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 231/478] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:17:17.635587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:17.636593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:17.646102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:17.646919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:17.647982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:17.649066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:17.898002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:17.907496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1f2fb1c9-0f1b-4730-a189-1455d6f91469 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.276176 Apr 08 12:17:17.908805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 248/479] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:17 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:18.212656 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:18.213423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:18.221589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.222100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:18.222966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.223464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:18.372120 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:18.372706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:18.382912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.383503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:18.384258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.384996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:18.480561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:18.490996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4af3bd21-3797-4ceb-84e5-a18b9c6e02d5 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1313 microversion: 2.1 time: 0.282751 Apr 08 12:17:18.491742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 232/480] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:18 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:18.605794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:18.616019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:18.617875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:18.619107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-12a7d149-5cea-41b0-8c84-9b51ad4e88d3 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1724 microversion: 2.20 time: 0.251016 Apr 08 12:17:18.619729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 249/481] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:18 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:18.639109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2760ecf5-6d97-4d60-83f3-406fd5f28dbf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6459f955-541d-42e7-9a5c-bae11053a857"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:18.640336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2760ecf5-6d97-4d60-83f3-406fd5f28dbf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:18.649228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2760ecf5-6d97-4d60-83f3-406fd5f28dbf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.649807 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2760ecf5-6d97-4d60-83f3-406fd5f28dbf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:18.650697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2760ecf5-6d97-4d60-83f3-406fd5f28dbf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.651202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2760ecf5-6d97-4d60-83f3-406fd5f28dbf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:18.925462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:18.926169 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:18.934120 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.934687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:18.935581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:18.936083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.140085 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:19.150158 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6002be60-82fd-431d-bc97-bf2a4a94eeed tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.228812 Apr 08 12:17:19.150829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 250/482] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:18 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:19.162780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:19.163335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:19.171297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.171807 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.172641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.173183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.242061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:17:19.426651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2760ecf5-6d97-4d60-83f3-406fd5f28dbf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.791724 Apr 08 12:17:19.427355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 233/483] 10.222.0.43 () {62 vars in 1354 bytes} [Thu Apr 8 12:17:18 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-volume_attachments => generated 188 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:17:19.455785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-19887b01-8a25-40b3-8926-cea7925517e7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 204 len: 0 microversion: 2.1 time: 0.296601 Apr 08 12:17:19.456444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 251/484] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:17:19 2021] DELETE /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:17:19.464853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:19.465648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:19.473673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.474184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.475200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.475700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.510294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:19.511306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:19.519480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.519994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.520841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.521339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.680672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:19.689685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2a9e88eb-5037-46f4-8ac8-4722f2d00da2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1515 microversion: 2.1 time: 0.228833 Apr 08 12:17:19.690270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 234/485] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:19 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:19.695108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d64edaea-db26-4dae-880a-4610d2130ea9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:19.695722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d64edaea-db26-4dae-880a-4610d2130ea9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:19.703353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d64edaea-db26-4dae-880a-4610d2130ea9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.703865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d64edaea-db26-4dae-880a-4610d2130ea9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.704845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d64edaea-db26-4dae-880a-4610d2130ea9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.705342 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d64edaea-db26-4dae-880a-4610d2130ea9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.725006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:19.734038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7f1bf8a3-2402-478e-9154-5627698e9695 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1497 microversion: 2.1 time: 0.228637 Apr 08 12:17:19.734712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 252/486] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:19 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:19.740156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-dc355e42-af14-4bbd-b0e7-70a93018ef90 req-af6641c5-4296-4025-b37d-ae6b4e45fab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704586d7-ad35-414f-af0c-5835b542f260", "name": "network-vif-unplugged", "status": "completed", "tag": "53f6e72e-034c-4c1c-be6e-8d0a69255cf0"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:19.741931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:19.741931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:19.751078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-dc355e42-af14-4bbd-b0e7-70a93018ef90 req-af6641c5-4296-4025-b37d-ae6b4e45fab9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.751588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-dc355e42-af14-4bbd-b0e7-70a93018ef90 req-af6641c5-4296-4025-b37d-ae6b4e45fab9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.769322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.compute.server_external_events [req-dc355e42-af14-4bbd-b0e7-70a93018ef90 req-af6641c5-4296-4025-b37d-ae6b4e45fab9 service nova] Unable to find a host for instance 704586d7-ad35-414f-af0c-5835b542f260. Dropping event network-vif-unplugged {{(pid=98473) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 08 12:17:19.770268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-dc355e42-af14-4bbd-b0e7-70a93018ef90 req-af6641c5-4296-4025-b37d-ae6b4e45fab9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034548 Apr 08 12:17:19.771078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 253/487] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:19 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 08 12:17:19.922213 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d64edaea-db26-4dae-880a-4610d2130ea9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action" status: 202 len: 0 microversion: 2.20 time: 0.230691 Apr 08 12:17:19.924446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 235/488] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:17:19 2021] POST /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:17:19.931747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:19.932418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:19.941360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.942237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:19.943024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:19.943518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:20.162725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:20.168154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:20.169219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:20.177639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:20.177639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:20.177639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-73eb3509-576b-4d7d-9e9c-b3e3c36045c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1750 microversion: 2.20 time: 0.250063 Apr 08 12:17:20.178530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 254/489] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:19 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1750 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:20.182656 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:20.186686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:20.187787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:20.189799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:20.420875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:20.431733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a21acb10-462d-44eb-b4e7-bd39201933d2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.267267 Apr 08 12:17:20.438831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 236/490] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:20 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:20.709052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:20.709743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:20.719949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:20.720489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:20.721755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:20.722288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:20.880778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:20.882057 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:20.893084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:20.893877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:20.895015 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:20.895498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:20.974373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:17:20.976972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:20.988530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7b33d483-94ab-4cb1-9f42-3be14488a887 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1515 microversion: 2.1 time: 0.284772 Apr 08 12:17:20.989439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 255/491] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:20 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:21.197374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:21.198019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:21.206454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:21.207038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:21.208556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:21.209075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:21.210372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-998417cb-ed2e-4754-8f34-10d8e90cd70a tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "DELETE /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 204 len: 0 microversion: 2.1 time: 0.335489 Apr 08 12:17:21.211022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 237/492] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:17:20 2021] DELETE /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:17:21.227349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:21.228348 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:21.237141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:21.238059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:21.239116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:21.239953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:21.463599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:21.473873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f8938fd3-1f36-4be7-9a14-5eaca3304baf tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1503 microversion: 2.1 time: 0.250826 Apr 08 12:17:21.474548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 238/493] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:21 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:21.479705 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:21.482790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:21.488955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:21.489468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:21.490329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:21.490865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:21.575203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:21.594734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:21.597212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:21.598523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ebbd0a74-39c7-45f3-b467-8742e3386320 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1750 microversion: 2.20 time: 0.405282 Apr 08 12:17:21.599356 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 256/494] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:21 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1750 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:21.699898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:21.709607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-be33717a-7ca6-47c0-90ff-0c47d2c644e2 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.233536 Apr 08 12:17:21.715726 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 239/495] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:21 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:22.008749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:22.009346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:22.017339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.017858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.018736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.019236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.334137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:22.343285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-731d8aeb-5dda-4d7e-ad11-365407cf4571 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1515 microversion: 2.1 time: 0.338818 Apr 08 12:17:22.343912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 257/496] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:22 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1515 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:22.493168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:22.493849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:22.503235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.503235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.504060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.504570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.618601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:22.619635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:22.631114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.632200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.633255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.634014 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.731213 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:22.742079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e0a52deb-cf7c-457f-81e9-1e9ea01a7bd6 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1503 microversion: 2.1 time: 0.252821 Apr 08 12:17:22.753008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 240/497] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:22 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:22.753008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:22.753008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:22.757923 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.758461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.759314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.759814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.918344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:22.929380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:22.931200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:22.932430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ffa518db-fd5f-4e61-ae6a-ca09ae4e07c2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1752 microversion: 2.20 time: 0.318691 Apr 08 12:17:22.933052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 258/498] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:22 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1752 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:22.938157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-2b1a62b1-7e0c-4dfc-8a49-227364e25dea req-cd187b81-eb48-45a3-a03e-e10978518029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537681fb-20cb-416c-8a3a-31a9e4107b84", "name": "network-vif-deleted", "tag": "64dad50b-c967-4c4a-a35d-db19f3683de0"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:22.940420 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:22.940420 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:22.949558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-2b1a62b1-7e0c-4dfc-8a49-227364e25dea req-cd187b81-eb48-45a3-a03e-e10978518029 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:22.950069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-2b1a62b1-7e0c-4dfc-8a49-227364e25dea req-cd187b81-eb48-45a3-a03e-e10978518029 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:22.968595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-2b1a62b1-7e0c-4dfc-8a49-227364e25dea req-cd187b81-eb48-45a3-a03e-e10978518029 service nova] Creating event network-vif-deleted:64dad50b-c967-4c4a-a35d-db19f3683de0 for instance 537681fb-20cb-416c-8a3a-31a9e4107b84 on hv-cinder-78477 Apr 08 12:17:22.973849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-2b1a62b1-7e0c-4dfc-8a49-227364e25dea req-cd187b81-eb48-45a3-a03e-e10978518029 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Apr 08 12:17:22.974540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 259/499] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:17:23.222265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:23.231997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-25c67694-cdae-4e4e-b2fa-db67ef1150a4 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.488189 Apr 08 12:17:23.232695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 241/500] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:22 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:23.362920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:23.363620 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:23.371981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:23.372536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:23.373627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:23.374124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:23.460021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:23.460537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:23.461053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lazy-loading 'fault' on Instance uuid 537681fb-20cb-416c-8a3a-31a9e4107b84 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:17:23.580192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:23.594879 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0cf4a7c7-00d8-4905-be21-5fad8d2c9fbb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 200 len: 1308 microversion: 2.1 time: 0.237322 Apr 08 12:17:23.595735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 260/501] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:23 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:23.761151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:23.762039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:23.771476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:23.771990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:23.772835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:23.773325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:23.954238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:23.955009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:23.963232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:23.963746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:23.964588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:23.965079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:24.169479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:24.181305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:24.183004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:24.184276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fcd43241-3bea-4c4e-80d0-a8dc69c32447 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1752 microversion: 2.20 time: 0.234439 Apr 08 12:17:24.185028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 261/502] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:23 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:24.250069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:24.250773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:24.258766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:24.259294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:24.260156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:24.260659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:24.477168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:24.487288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b4b12638-03b9-451c-994c-098875e8a9ef tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.241423 Apr 08 12:17:24.488067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 262/503] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:24 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:24.518706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:24.527580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-beda0cf9-3492-47eb-8504-6b214954cb31 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1503 microversion: 2.1 time: 0.770489 Apr 08 12:17:24.528248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 242/504] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:23 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1503 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:24.613718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:24.614447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 537681fb-20cb-416c-8a3a-31a9e4107b84] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:24.622550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:24.623072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:24.627374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:24.627374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:24.683910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] HTTP exception thrown: Instance 537681fb-20cb-416c-8a3a-31a9e4107b84 could not be found. Apr 08 12:17:24.684579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Returning 404 to user: Instance 537681fb-20cb-416c-8a3a-31a9e4107b84 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:17:24.685483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-885c2f7e-996f-4184-b7a8-e6ba2b15904e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84" status: 404 len: 111 microversion: 2.1 time: 0.076265 Apr 08 12:17:24.686098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 263/505] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:24 2021] GET /compute/v2.1/servers/537681fb-20cb-416c-8a3a-31a9e4107b84 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:17:24.812684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-a78c5c75-c73e-4f54-890b-6178fb768655 req-eff57d4d-e271-4fd1-bd45-42b39f78c5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d60c14-af1c-4517-b5c6-7f606012724c", "name": "network-vif-deleted", "tag": "2a5f01f5-e80b-48ac-af81-19fbc5df5c69"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:24.814921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:24.814921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:24.824050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a78c5c75-c73e-4f54-890b-6178fb768655 req-eff57d4d-e271-4fd1-bd45-42b39f78c5ba service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:24.824699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a78c5c75-c73e-4f54-890b-6178fb768655 req-eff57d4d-e271-4fd1-bd45-42b39f78c5ba service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:24.844402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-a78c5c75-c73e-4f54-890b-6178fb768655 req-eff57d4d-e271-4fd1-bd45-42b39f78c5ba service nova] Creating event network-vif-deleted:2a5f01f5-e80b-48ac-af81-19fbc5df5c69 for instance 51d60c14-af1c-4517-b5c6-7f606012724c on hv-cinder-78477 Apr 08 12:17:24.850887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-a78c5c75-c73e-4f54-890b-6178fb768655 req-eff57d4d-e271-4fd1-bd45-42b39f78c5ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042121 Apr 08 12:17:24.851551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 243/506] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:17:25.203756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:25.205046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:25.212924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:25.213441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:25.214293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:25.214819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:25.433512 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:25.444637 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:25.446480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:25.447823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e19d35d5-1575-4bb3-95ee-7b9f169f5d2a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1752 microversion: 2.20 time: 0.248242 Apr 08 12:17:25.448409 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 264/507] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:25 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:25.506720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:25.507574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:25.515779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:25.516310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:25.518900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:25.518900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:25.546711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:25.547382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:25.556580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:25.557084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:25.557921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:25.558436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:25.634955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:25.635502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:25.636020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lazy-loading 'fault' on Instance uuid 51d60c14-af1c-4517-b5c6-7f606012724c {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:17:25.703677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3786ec5feb8460da013a34f428b22f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af83a5bec643c1bf2d8a3ede4b9a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:25.713021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-118a8321-baa1-464c-be30-e4a527fb2e78 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 200 len: 1303 microversion: 2.1 time: 0.170344 Apr 08 12:17:25.713977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 265/508] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:25 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:25.722549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:25.732083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-44294835-ff73-4e6a-9473-880f08c8fe70 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.230482 Apr 08 12:17:25.732726 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 244/509] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:25 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:25.999722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:26.000278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:26.008835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.009349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.010190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.010734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.080172 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:17:26.288920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8d2bd371-e4b3-467b-8a18-118849db7578 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 204 len: 0 microversion: 2.1 time: 0.293051 Apr 08 12:17:26.289575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 266/510] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:17:25 2021] DELETE /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:17:26.299772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:26.306443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:26.308004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.308526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.309365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.309857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.468466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:26.469245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:26.477768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.478283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.480509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.480509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.523706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:26.534362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b3477b29-53b1-4976-80c6-5fcf2e4906fa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.238643 Apr 08 12:17:26.535553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 245/511] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:26 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:26.700336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:26.715876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:26.718176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:26.719776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59763472-e26c-42d0-a525-3818c320c9e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.255814 Apr 08 12:17:26.721104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 267/512] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:26 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:26.738948 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:26.740035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] [instance: 51d60c14-af1c-4517-b5c6-7f606012724c] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:26.749638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:26.750264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.750598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:26.751139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.752769 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.753417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.763581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.764353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.765328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:26.766155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:26.847993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] HTTP exception thrown: Instance 51d60c14-af1c-4517-b5c6-7f606012724c could not be found. Apr 08 12:17:26.848695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] Returning 404 to user: Instance 51d60c14-af1c-4517-b5c6-7f606012724c could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:17:26.849625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d75c98c8-fe53-4a00-b28f-d9ae061a9b86 tempest-VolumesActionsTest-1658222495 tempest-VolumesActionsTest-1658222495-project] 10.222.0.43 "GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c" status: 404 len: 111 microversion: 2.1 time: 0.115893 Apr 08 12:17:26.854344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 246/513] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:26 2021] GET /compute/v2.1/servers/51d60c14-af1c-4517-b5c6-7f606012724c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:17:27.049578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:27.064878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-63d9ee27-2367-4687-9340-732d4b114635 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.316477 Apr 08 12:17:27.066775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 268/514] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:26 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:27.553495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:27.554168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:27.562005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:27.562573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:27.563461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:27.565095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:27.741610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:27.742405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:27.750770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:27.751491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:27.752440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:27.752999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:27.788750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:27.799866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b6ba2d52-832a-4c6e-824a-f2011b3f2636 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.251398 Apr 08 12:17:27.800817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 247/515] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:27 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:28.007850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:28.019501 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:28.021946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:28.023359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6c439f55-6aa2-47fb-b405-3f86bdec3796 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.286528 Apr 08 12:17:28.024077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 269/516] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:27 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:28.086768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:28.087556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:28.099575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:28.100137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:28.101103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:28.103026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:28.351382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:28.361556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-754c1c6a-d0f5-49bc-aa98-6290cc89d352 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.281001 Apr 08 12:17:28.362352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 248/517] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:28 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:28.817998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:28.818763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:28.826759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:28.827275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:28.828113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:28.828607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:29.020733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:29.029541 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-23f5eb23-9aa3-4d70-a76b-ab5de844d401 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.215742 Apr 08 12:17:29.030166 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 270/518] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:28 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:29.043751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:29.044457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:29.052375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:29.052888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:29.053721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:29.054216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:29.265002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:29.275793 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:29.277475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:29.278737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a0a2af7b-a1ea-4105-9d5c-ce32da7f5303 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.239122 Apr 08 12:17:29.279359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 249/519] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:29 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:17:29.380889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:29.381594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:29.389980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:29.390654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:29.391526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:29.392625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:29.599704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:29.608198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c4a9c586-7069-44cd-bd41-bf1f6ce7761e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.232277 Apr 08 12:17:29.608875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 271/520] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:29 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:30.048352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:30.049042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:30.057622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:30.058129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:30.058993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:30.059489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:30.268484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:30.277434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-57c543ca-8447-49ba-893b-d72a0abb319b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.233153 Apr 08 12:17:30.278058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 250/521] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:30 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:30.299596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:30.300386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:30.308496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:30.309017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:30.309866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:30.310387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:30.506067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:30.516081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:30.518282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:30.519521 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d5162917-fb1a-400b-998c-76a24c162a02 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.224761 Apr 08 12:17:30.520140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 272/522] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:30 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:30.627423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:30.628101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:30.636011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:30.640095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:30.640095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:30.640095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:30.848249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:30.854040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cddea1db-c1a6-4218-b92b-dd71f756a7f7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.231074 Apr 08 12:17:30.854697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 251/523] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:30 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:31.296679 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:31.297358 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:31.306716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:31.306716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:31.308152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:31.308648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:31.507140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:31.516059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-14d3ab53-09ba-4b46-8ffe-5258800df6ec tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.223400 Apr 08 12:17:31.516722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 273/524] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:31 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:31.539730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:31.540402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:31.548967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:31.549423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:31.550260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:31.550784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:31.760114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:31.771075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:31.773219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:31.774527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1c06e635-ee96-445b-8609-5e8959e31121 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.238930 Apr 08 12:17:31.775191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 252/525] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:31 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:31.872448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:31.873102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:31.881673 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:31.882175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:31.883071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:31.883560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:32.077021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:32.087010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-83848792-6e03-4477-a184-403b9a913149 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.218630 Apr 08 12:17:32.087636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 274/526] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:31 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:32.535136 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:32.536151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:32.546433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:32.547093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:32.548229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:32.548935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:32.796273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:32.796273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:32.800902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:32.807488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:32.808013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:32.808898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:32.809391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:32.811130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a1db08a1-200a-40e3-a108-0c364b65821a tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.281604 Apr 08 12:17:32.813221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 253/527] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:32 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:33.058116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:33.070208 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:33.071979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:33.073213 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-36c2351f-ab41-46fe-b829-f0d811d0ba20 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.281921 Apr 08 12:17:33.073830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 275/528] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:32 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:33.105587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:33.106463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:33.115421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:33.115944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:33.116803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:33.117304 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:33.395334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:33.416319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-31f38dc4-bf9e-4345-bb47-0f38ec060d02 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.314899 Apr 08 12:17:33.417161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 254/529] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:33 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:33.830915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:33.831573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:33.839942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:33.840632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:33.841367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:33.841955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:34.120399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:34.120399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:34.129736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:34.131541 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:34.133083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:34.133638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:34.141001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:34.152616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-81aa3eee-cdb5-4c5e-a402-a65de29c2e40 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.325865 Apr 08 12:17:34.153531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 276/530] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:33 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:34.374983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:34.402502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:34.404193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:34.405441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-337c2694-0b97-4f3a-9703-076012d61df2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.292896 Apr 08 12:17:34.406072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 255/531] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:34 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:34.434486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:34.435507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:34.444561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:34.445058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:34.445929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:34.458516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:34.730187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:34.740212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-98bbecdf-ee05-4fee-a1a1-8af48784a00e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.309801 Apr 08 12:17:34.741033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 277/532] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:34 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:35.171972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:35.173375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:35.181766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:35.182449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:35.183420 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:35.184334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:35.421860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:35.427643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:35.430625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:35.444561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0e4b3a20-3d50-4f99-9bcc-5914c693f76b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.276458 Apr 08 12:17:35.447177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 256/533] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:35 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:35.448550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:35.449127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:35.450226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:35.450827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:35.696155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:35.743341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:35.745331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:35.746687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-17c61345-aace-4b9a-ba4a-d34c865164cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.323179 Apr 08 12:17:35.748338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 278/534] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:35 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:35.758533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:35.759357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:35.770373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:35.779145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:35.783878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:35.784544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:36.105350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:36.112728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-14947540-1ab9-4f69-a8cb-038472f81d1e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.358307 Apr 08 12:17:36.113356 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 257/535] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:35 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:36.465067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:36.465822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:36.479720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:36.487296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:36.488564 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:36.489157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:36.741050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:36.757544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c921042b-7510-4bc6-aa25-6d61548343c7 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.292285 Apr 08 12:17:36.768873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 279/536] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:36 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:36.774743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:36.775780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:36.790728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:36.791553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:36.792605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:36.795051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:37.131926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:37.132626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:37.142659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:37.143134 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:37.144025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:37.144523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:37.153781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:37.165355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:37.167145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:37.168419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-35931938-4839-437c-9eff-92ff7d1d587c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.397855 Apr 08 12:17:37.169042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 258/537] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:36 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:37.470519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:37.482794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1b071bc7-57f2-44c9-a4ae-cab52f5c83a6 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.355544 Apr 08 12:17:37.484002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 280/538] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:37 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:37.777022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:37.777617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:37.786555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:37.787067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:37.787948 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:37.790000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:38.021058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:38.038013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-97c903cd-ca2d-4daf-8e23-2bd095c03fb2 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.264878 Apr 08 12:17:38.038704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 259/539] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:37 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:38.193596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:38.194274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:38.215523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:38.216029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:38.216889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:38.217382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:38.482111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:38.493515 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:38.495109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:38.496340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a2e4bde0-158d-4c95-9810-c61609cbadd2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.308008 Apr 08 12:17:38.497274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 281/540] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:38 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:38.505480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:38.506694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:38.519347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:38.520496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:38.521917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:38.522816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:38.850430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:38.861743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-638a5ba3-ec9d-4ee8-9260-736e54fa298f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.361066 Apr 08 12:17:38.862421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 260/541] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:38 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:39.057502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:39.061170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:39.067255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:39.067708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:39.068736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:39.069642 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:39.293423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:39.302422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-79ab649a-b871-422e-b9c5-93d5210b853f tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.249856 Apr 08 12:17:39.303044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 282/542] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:39 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:39.518529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:39.519199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:39.527128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:39.527648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:39.528493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:39.528996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:39.757932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:39.757932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:39.758273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:39.758273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-01812cf6-2686-43bd-a357-f1aaadb37e03 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.224570 Apr 08 12:17:39.758273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 261/543] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:39 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:39.880607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:39.881269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:39.889749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:39.890330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:39.891161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:39.891686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:40.107450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:40.118163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-899bf175-1dfb-4d4c-8a93-9b4e3c4113ac tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.242483 Apr 08 12:17:40.118819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 283/544] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:39 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:40.321021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:40.321703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:40.331712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:40.332240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:40.333103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:40.333615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:40.696015 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:40.710261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-506c5a41-30a9-43d8-b562-111f993b693d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.393790 Apr 08 12:17:40.710961 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 262/545] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:40 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:40.775710 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:40.776418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:40.784653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:40.785165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:40.786021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:40.786543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:41.004527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:41.034156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:41.036655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:41.038017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6ca62237-1b12-4af1-912c-333c19b138ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.266439 Apr 08 12:17:41.038685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 284/546] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:40 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:41.136013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:41.136621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:41.144969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:41.145498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:41.146409 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:41.146922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:41.366947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:41.377007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3612a87e-c427-4cfb-ab35-9d65119660a7 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.244786 Apr 08 12:17:41.387299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 263/547] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:41 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:41.729751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:41.730730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:41.740176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:41.740969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:41.742147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:41.742768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:42.005207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:42.015048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d645406a-6a25-42b9-bce6-5f63596c9a07 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1515 microversion: 2.1 time: 0.289348 Apr 08 12:17:42.015846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 285/548] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:41 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:42.059191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:42.060457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:42.070442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:42.071274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:42.072227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:42.072891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:42.397256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:42.397948 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:42.415794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:42.427804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:42.433979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:42.433979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:42.433979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:42.433979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:42.435744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:42.440417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-501e6d44-d8e0-4cf1-9b49-12c80012c207 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.385528 Apr 08 12:17:42.441549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 264/549] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:42 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:42.723888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:42.734464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2590c09f-7e09-4c6e-b9da-af15a9121422 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.343126 Apr 08 12:17:42.735125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 286/550] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:42 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:43.033520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:43.035278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:43.047051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:43.050207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:43.051348 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:43.052417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:43.461931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:43.463102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:43.486699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:43.493743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:43.494864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:43.515270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:43.642091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:43.651363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-adffdfe9-5b76-48f7-8826-b196c5e9bc5c tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1473 microversion: 2.1 time: 0.622047 Apr 08 12:17:43.652218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 265/551] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:43 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1473 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:43.754386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:43.755544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:43.763853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:43.764595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:43.765603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:43.766246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:43.818462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:43.832549 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:43.834380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:43.835738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-311013cc-56e7-4c3d-bceb-67a856104446 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.379040 Apr 08 12:17:43.836440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 287/552] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:43 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:43.878729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-77613eb7-b26b-4d57-bb2e-5f7ab1eb8a5f req-8a4dd73d-b5aa-4cb7-8149-1b2d2ee90245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375264eb-09f6-4413-9158-84ecfa8a4c9a", "name": "network-vif-deleted", "tag": "c29b9742-45bf-41e2-8335-cb85ed46dc8d"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:43.881043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:43.881043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:43.890767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-77613eb7-b26b-4d57-bb2e-5f7ab1eb8a5f req-8a4dd73d-b5aa-4cb7-8149-1b2d2ee90245 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:43.891279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-77613eb7-b26b-4d57-bb2e-5f7ab1eb8a5f req-8a4dd73d-b5aa-4cb7-8149-1b2d2ee90245 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:43.909912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-77613eb7-b26b-4d57-bb2e-5f7ab1eb8a5f req-8a4dd73d-b5aa-4cb7-8149-1b2d2ee90245 service nova] Creating event network-vif-deleted:c29b9742-45bf-41e2-8335-cb85ed46dc8d for instance 375264eb-09f6-4413-9158-84ecfa8a4c9a on hv-cinder-78477 Apr 08 12:17:43.915464 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-77613eb7-b26b-4d57-bb2e-5f7ab1eb8a5f req-8a4dd73d-b5aa-4cb7-8149-1b2d2ee90245 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042591 Apr 08 12:17:43.916133 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 288/553] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:17:44.049020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:44.060895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1f00c46f-bb3b-45ca-96e2-7b5813cb8728 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1568 microversion: 2.1 time: 0.312395 Apr 08 12:17:44.073169 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 266/554] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:43 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:44.697196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:44.697196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:44.703556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:44.704071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:44.704923 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:44.705438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:44.781724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:44.782247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:44.782902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lazy-loading 'fault' on Instance uuid 375264eb-09f6-4413-9158-84ecfa8a4c9a {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:17:44.855632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:44.856299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:44.861703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:44.864925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:44.865442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:44.866291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:44.866807 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:44.875177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ad0f5b2e-0543-4e3a-b0e3-49879c400ba1 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 200 len: 1308 microversion: 2.1 time: 0.199593 Apr 08 12:17:44.875640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 289/555] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:44 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:45.081835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:45.082457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:45.094610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.095171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.096055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.097113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.111294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:45.121936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:45.123891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:45.125124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c01988fd-6ae9-4bd8-8d10-34fa1e7a2c4d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.273604 Apr 08 12:17:45.125922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 267/556] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:44 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:45.318485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:45.330117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c1037add-0ce0-4e23-8f09-8888992c3a50 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1548 microversion: 2.1 time: 0.252767 Apr 08 12:17:45.343677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 290/557] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:45 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1548 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:45.349255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:45.349806 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:45.357841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.358488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.359456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.359953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.555588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] HTTP exception thrown: Cannot 'detach_volume' instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 while it is in vm_state rescued Apr 08 12:17:45.556268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Returning 409 to user: Cannot 'detach_volume' instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 while it is in vm_state rescued {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:17:45.557185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-194cd721-e863-4bd7-9ee8-a72ac8a3b010 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments/39f28de5-b4e6-4024-aa8c-909ee67713ac" status: 409 len: 152 microversion: 2.1 time: 0.212900 Apr 08 12:17:45.557934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 268/558] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:17:45 2021] DELETE /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments/39f28de5-b4e6-4024-aa8c-909ee67713ac => generated 152 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 08 12:17:45.567652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9d8ca60c-6ee2-4239-ad67-16e9ae22954c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:45.568759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9d8ca60c-6ee2-4239-ad67-16e9ae22954c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:45.578885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8ca60c-6ee2-4239-ad67-16e9ae22954c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.579467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8ca60c-6ee2-4239-ad67-16e9ae22954c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.580363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8ca60c-6ee2-4239-ad67-16e9ae22954c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.580803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8ca60c-6ee2-4239-ad67-16e9ae22954c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.795750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9d8ca60c-6ee2-4239-ad67-16e9ae22954c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action" status: 202 len: 0 microversion: 2.1 time: 0.232645 Apr 08 12:17:45.796697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 291/559] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:17:45 2021] POST /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:17:45.806130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:45.806834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:45.815154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.815707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.816683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.817204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.895640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:45.896337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 375264eb-09f6-4413-9158-84ecfa8a4c9a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:45.904895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.905410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.906264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.906809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.972289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] HTTP exception thrown: Instance 375264eb-09f6-4413-9158-84ecfa8a4c9a could not be found. Apr 08 12:17:45.972962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Returning 404 to user: Instance 375264eb-09f6-4413-9158-84ecfa8a4c9a could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:17:45.973869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a14b118f-aed5-48f9-ab90-1be9d13948d6 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a" status: 404 len: 111 microversion: 2.1 time: 0.083709 Apr 08 12:17:45.974530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 292/560] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:45 2021] GET /compute/v2.1/servers/375264eb-09f6-4413-9158-84ecfa8a4c9a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:17:45.984077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:45.989467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:45.993852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.994493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:45.995425 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:45.995998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:46.072898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:17:46.155048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:46.165650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b26f9c8-ee4d-424a-ab64-8be8b6e7f16c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1556 microversion: 2.1 time: 0.363528 Apr 08 12:17:46.167783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 269/561] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:45 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1556 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:46.171671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:46.172459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:46.186928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:46.187451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:46.188347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:46.188859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:46.312387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-07899b1d-cfbc-4cdf-b997-0601062587d5 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 204 len: 0 microversion: 2.1 time: 0.332151 Apr 08 12:17:46.313127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 293/562] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:17:45 2021] DELETE /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:17:46.324278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:46.325106 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:46.335212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:46.335758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:46.336657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:46.337183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:46.560222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:46.571144 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f49e3110-44ee-4c4e-87fc-3d252410812e tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1514 microversion: 2.1 time: 0.251647 Apr 08 12:17:46.571982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 294/563] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:46 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:46.779591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:46.791774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:46.793462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:46.795047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8f368277-c55b-453e-a8f5-fcf8d315e29e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.627187 Apr 08 12:17:46.796045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 270/564] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:46 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:47.183777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:47.184536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:47.193659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:47.194181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:47.195082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:47.195598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:47.444897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:47.466885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f1117726-5b12-4301-8827-9c49aaf48d94 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1556 microversion: 2.1 time: 0.287128 Apr 08 12:17:47.467646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 295/565] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:47 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1556 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:47.592049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:47.592904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:47.606998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:47.606998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:47.621404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:47.621404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:47.814982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:47.815733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:47.823840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:47.824362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:47.825213 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:47.825715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:47.891129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:47.901479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4a4dd29b-2fe6-4847-ae92-20b5eec0542b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1514 microversion: 2.1 time: 0.314823 Apr 08 12:17:47.902323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 271/566] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:47 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:48.173376 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:48.184067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:48.185732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:48.187026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-609bc8f1-1fe9-442a-a550-758e1fabb70c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.376163 Apr 08 12:17:48.199022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 296/567] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:47 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:48.485587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:48.486269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:48.495795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:48.496314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:48.497189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:48.497699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:48.878355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:48.891439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9b850c5a-b2ce-4f32-ae7e-883fd066913f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1556 microversion: 2.1 time: 0.410029 Apr 08 12:17:48.892074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 272/568] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:48 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1556 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:48.919675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:48.920355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:48.931871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:48.932902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:48.933976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:48.936625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:49.206909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:49.207597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:49.217973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:49.218785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:49.220204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:49.220861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:49.250179 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:49.261679 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e8218536-68e9-4c44-b8e7-f0a30c3937aa tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 200 len: 1472 microversion: 2.1 time: 0.345915 Apr 08 12:17:49.274432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 297/569] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:48 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:49.317165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-336a4d59-129a-4fbe-9b3f-82ae1afae3cd req-84e9d2d9-93e1-45ea-ae1c-5fa3ae0bfb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb", "name": "network-vif-deleted", "tag": "5a94a06b-3cc9-4eb2-b8aa-2a61327d0119"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:49.319137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:49.319137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:49.335158 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-336a4d59-129a-4fbe-9b3f-82ae1afae3cd req-84e9d2d9-93e1-45ea-ae1c-5fa3ae0bfb99 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:49.335969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-336a4d59-129a-4fbe-9b3f-82ae1afae3cd req-84e9d2d9-93e1-45ea-ae1c-5fa3ae0bfb99 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:49.356171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-336a4d59-129a-4fbe-9b3f-82ae1afae3cd req-84e9d2d9-93e1-45ea-ae1c-5fa3ae0bfb99 service nova] Creating event network-vif-deleted:5a94a06b-3cc9-4eb2-b8aa-2a61327d0119 for instance 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb on hv-cinder-78477 Apr 08 12:17:49.361654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-336a4d59-129a-4fbe-9b3f-82ae1afae3cd req-84e9d2d9-93e1-45ea-ae1c-5fa3ae0bfb99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051729 Apr 08 12:17:49.363136 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 298/570] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:17:49.463535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:49.476064 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:49.478496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:49.479899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-266bcd13-3bac-41ff-894f-34727f00eabc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.277909 Apr 08 12:17:49.480972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 273/571] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:49 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:49.494250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:17:49.494881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:17:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:17:49.910708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:49.911419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:49.935350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:49.935867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:49.936735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:49.937233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:50.259633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:50.285305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:50.291361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:50.296450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2d39fb4a-cad1-4112-afca-2a0bfa38b64b tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1562 microversion: 2.1 time: 0.390810 Apr 08 12:17:50.307059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 299/572] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:49 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1562 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:50.312834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:50.313880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:50.316493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:50.317560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:50.384763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] HTTP exception thrown: Instance 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb could not be found. Apr 08 12:17:50.385942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Returning 404 to user: Instance 1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:17:50.387097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d00eed7c-bf7a-4d0b-81cd-e8712602819b tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb" status: 404 len: 111 microversion: 2.1 time: 0.111204 Apr 08 12:17:50.388477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 274/573] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:50 2021] GET /compute/v2.1/servers/1ea4d9e7-9c42-4a6b-ac35-9923cd87afdb => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:17:50.467915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:50.468687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:50.477022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:50.477959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:50.479033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:50.479885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:50.499439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:50.500158 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:50.510007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:50.514640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:50.514640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:50.514640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:50.692104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lazy-loading 'services' on Instance uuid d63b515b-cd97-4a20-a16f-7b1f3eba4460 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:17:50.778340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:50.789869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:50.791862 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:50.793106 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-221a1508-1d89-4c19-a71d-a22ed47ee5ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.298114 Apr 08 12:17:50.793707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 275/574] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:50 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:50.980385 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-16501eda-696b-48e0-83e1-bafebc2ee155 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments/39f28de5-b4e6-4024-aa8c-909ee67713ac" status: 202 len: 0 microversion: 2.1 time: 0.516446 Apr 08 12:17:50.980959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 300/575] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:17:50 2021] DELETE /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460/os-volume_attachments/39f28de5-b4e6-4024-aa8c-909ee67713ac => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:17:51.676033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-23bac539-4b49-4e44-8013-70d0f56c5e32 req-ee624bed-2a8e-45d0-9787-c3aea039d8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704586d7-ad35-414f-af0c-5835b542f260", "name": "network-vif-plugged", "status": "completed", "tag": "53f6e72e-034c-4c1c-be6e-8d0a69255cf0"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:51.678640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:51.678640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:51.688400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-23bac539-4b49-4e44-8013-70d0f56c5e32 req-ee624bed-2a8e-45d0-9787-c3aea039d8b2 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:51.692855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-23bac539-4b49-4e44-8013-70d0f56c5e32 req-ee624bed-2a8e-45d0-9787-c3aea039d8b2 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:51.708171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-23bac539-4b49-4e44-8013-70d0f56c5e32 req-ee624bed-2a8e-45d0-9787-c3aea039d8b2 service nova] Creating event network-vif-plugged:53f6e72e-034c-4c1c-be6e-8d0a69255cf0 for instance 704586d7-ad35-414f-af0c-5835b542f260 on hv-cinder-78477 Apr 08 12:17:51.714780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-23bac539-4b49-4e44-8013-70d0f56c5e32 req-ee624bed-2a8e-45d0-9787-c3aea039d8b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042637 Apr 08 12:17:51.715952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 276/576] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:17:51.814880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:51.815887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:51.833348 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:51.834127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:51.835199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:51.838828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:51.879918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:51.879918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:51.887096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:51.887609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:51.888466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:51.888966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:51.997046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:17:52.077896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:52.089067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:52.090798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:52.092024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-380f9b91-3834-44b6-a445-5470ee49f7fd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.283263 Apr 08 12:17:52.094405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 301/577] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:51 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:52.301168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fcd02690-2e14-4b53-aa75-8e9b71f3d6cf tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 204 len: 0 microversion: 2.1 time: 0.426878 Apr 08 12:17:52.301805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 277/578] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:17:51 2021] DELETE /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:17:52.310261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:52.310980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:52.319573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:52.320092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:52.320935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:52.321431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:52.545264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:52.554552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-98b3b817-8ac5-44d7-b9a9-5f89ddecde7d tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1514 microversion: 2.1 time: 0.248208 Apr 08 12:17:52.555102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 302/579] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:52 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:53.113016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:53.113854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:53.123151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:53.123923 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:53.124770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:53.125275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:53.330016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:53.342694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:53.344304 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:53.345522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-84fde66e-29c5-4f78-8a6f-1e45d4ea1273 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.237084 Apr 08 12:17:53.346138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 278/580] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:53 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:53.574295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:53.575104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:53.583748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:53.584424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:53.585470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:53.586168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:53.786434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:53.795722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ec3a071d-c0f8-405c-852a-b4234c661605 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1514 microversion: 2.1 time: 0.226002 Apr 08 12:17:53.796347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 303/581] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:53 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:54.365638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:54.366338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:54.375028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:54.375548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:54.376472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:54.376973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:54.639386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:54.654122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:54.654122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:54.654122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f67dd48d-4cfb-4b4d-a298-6a44775ca095 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1808 microversion: 2.20 time: 0.291760 Apr 08 12:17:54.654497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 279/582] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:54 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:54.814055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:54.814899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:54.823830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:54.824343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:54.825313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:54.825809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:55.053652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:55.064096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6eb55f4c-d651-46c7-b72f-3be28f1e7572 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1514 microversion: 2.1 time: 0.254092 Apr 08 12:17:55.064708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 304/583] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:54 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:17:55.673209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:55.673989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:55.682773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:55.683365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:55.684278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:55.684845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:55.940942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-e9a6c08e-8d58-4c18-aabc-769ca2e64912 req-3a283235-9e20-4a90-8bf3-f477eaf9258d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a", "name": "network-vif-deleted", "tag": "e462b605-b4cf-4d87-9526-70194bb10bd6"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:17:55.943008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:17:55.943008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:17:55.952132 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e9a6c08e-8d58-4c18-aabc-769ca2e64912 req-3a283235-9e20-4a90-8bf3-f477eaf9258d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:55.952662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e9a6c08e-8d58-4c18-aabc-769ca2e64912 req-3a283235-9e20-4a90-8bf3-f477eaf9258d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:55.971873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-e9a6c08e-8d58-4c18-aabc-769ca2e64912 req-3a283235-9e20-4a90-8bf3-f477eaf9258d service nova] Creating event network-vif-deleted:e462b605-b4cf-4d87-9526-70194bb10bd6 for instance c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a on hv-cinder-78477 Apr 08 12:17:55.977990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-e9a6c08e-8d58-4c18-aabc-769ca2e64912 req-3a283235-9e20-4a90-8bf3-f477eaf9258d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041117 Apr 08 12:17:55.978585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 305/584] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:17:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:17:55.996491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:56.006996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:56.016040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:56.016040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-26a1fbfb-7138-412f-9936-3993e6fda069 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1795 microversion: 2.20 time: 0.340976 Apr 08 12:17:56.016040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 280/585] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:17:55 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1795 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:17:56.083561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:56.084016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:56.084226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:56.084854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:56.093721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:56.094129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:56.094238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:56.094723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:56.095104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:56.095579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:56.095677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:56.096084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:56.164803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:17:56.293139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ac1ec4656f4449ac95090c4a6c9b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0104642b5c2d4d15bccda4263a3cbd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:56.302136 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-527d4bec-0df3-4713-b4e1-b9d35e2885c8 tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 200 len: 1303 microversion: 2.1 time: 0.222260 Apr 08 12:17:56.302806 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 281/586] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:56 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:56.397489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-95c84101-05bb-4d9f-92a4-769a3837c9a8 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "DELETE /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 204 len: 0 microversion: 2.1 time: 0.318181 Apr 08 12:17:56.398722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 306/587] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:17:56 2021] DELETE /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:17:56.407765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:56.408440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:56.425733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:56.426238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:56.427112 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:56.427606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:56.656877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:56.668197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e1e87bdc-b8f2-4207-8c0e-c30a7ef7075c tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1508 microversion: 2.1 time: 0.264647 Apr 08 12:17:56.668842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 282/588] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:56 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:57.320274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:57.321089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] [instance: c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:57.329040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:57.329554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:57.330430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:57.330929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:57.384856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] HTTP exception thrown: Instance c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a could not be found. Apr 08 12:17:57.385330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] Returning 404 to user: Instance c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:17:57.386613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9b67864c-b027-400b-96df-4146b2b6bccb tempest-AttachVolumeNegativeTest-763047664 tempest-AttachVolumeNegativeTest-763047664-project] 10.222.0.43 "GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a" status: 404 len: 111 microversion: 2.1 time: 0.070642 Apr 08 12:17:57.386890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 307/589] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:57 2021] GET /compute/v2.1/servers/c7ef44a5-acd9-4442-93a5-e8f68b6f9e0a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:17:57.685786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:57.686750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:57.695633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:57.696164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:57.697163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:57.697728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:58.033130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:58.042367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0f8744fd-024b-477a-a0bb-84046e0aec1f tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1508 microversion: 2.1 time: 0.360528 Apr 08 12:17:58.052388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 283/590] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:57 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:17:59.061899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:17:59.062625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:17:59.071922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:59.072439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:59.073290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:17:59.074036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:17:59.290463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:17:59.300346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b414f40e-cf44-461c-acb1-efece2eb097e tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1508 microversion: 2.1 time: 0.243343 Apr 08 12:17:59.300502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 308/591] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:17:59 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:00.317775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:00.318565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:00.327384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:00.328201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:00.329260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:00.330253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:00.372285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-ca7943f0-206c-448d-8581-c57de921a670 req-71033335-9f1b-4146-9560-d37bb232541c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621d3032-5955-4802-8608-e77c44fb5846", "name": "network-vif-deleted", "tag": "c6bbbadb-8a8e-4ec6-b503-169a587e171f"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:00.374248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:18:00.374248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:18:00.383566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ca7943f0-206c-448d-8581-c57de921a670 req-71033335-9f1b-4146-9560-d37bb232541c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:00.385109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ca7943f0-206c-448d-8581-c57de921a670 req-71033335-9f1b-4146-9560-d37bb232541c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:00.416476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-ca7943f0-206c-448d-8581-c57de921a670 req-71033335-9f1b-4146-9560-d37bb232541c service nova] Creating event network-vif-deleted:c6bbbadb-8a8e-4ec6-b503-169a587e171f for instance 621d3032-5955-4802-8608-e77c44fb5846 on hv-cinder-78477 Apr 08 12:18:00.427496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-ca7943f0-206c-448d-8581-c57de921a670 req-71033335-9f1b-4146-9560-d37bb232541c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059068 Apr 08 12:18:00.428347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 309/592] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:18:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:00.590017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:00.599076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-76b7021c-04ca-4725-8c2c-782293d19653 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 200 len: 1466 microversion: 2.1 time: 0.285537 Apr 08 12:18:00.599711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 284/593] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:00 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 1466 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:01.259740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:01.260617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:01.269002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:01.269651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:01.270652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:01.271271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:01.455323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lazy-loading 'services' on Instance uuid 5318a0d2-3723-47d4-9ec0-700cbb4cab5b {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:18:01.623098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:01.627419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: 621d3032-5955-4802-8608-e77c44fb5846] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:01.632922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:01.633443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:01.634410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:01.634906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:01.656341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5ad069dd-8614-403c-9309-2bf9d3447499 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/os-volume_attachments/51cabf24-d23a-4fcd-bd3d-91b8934cfbe0" status: 202 len: 0 microversion: 2.1 time: 0.401262 Apr 08 12:18:01.657696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 310/594] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:18:01 2021] DELETE /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/os-volume_attachments/51cabf24-d23a-4fcd-bd3d-91b8934cfbe0 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:18:01.710008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] HTTP exception thrown: Instance 621d3032-5955-4802-8608-e77c44fb5846 could not be found. Apr 08 12:18:01.713090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Returning 404 to user: Instance 621d3032-5955-4802-8608-e77c44fb5846 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:01.714693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-301b583a-bbbd-4a74-98d0-9752852bb77d tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846" status: 404 len: 111 microversion: 2.1 time: 0.101138 Apr 08 12:18:01.715607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 285/595] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:01 2021] GET /compute/v2.1/servers/621d3032-5955-4802-8608-e77c44fb5846 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:18:01.735958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:01.735958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:01.743455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:01.744192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:01.745217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:01.745714 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:01.824877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:18:01.840837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-98b48b95-2317-4b46-af2b-2af06678a1d4 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Action: 'create', calling method: .version_select at 0x7f225d905400>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1685674880"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:02.066419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e966593e-6ce8-4389-ba40-011ce31e7b15 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 204 len: 0 microversion: 2.1 time: 0.345951 Apr 08 12:18:02.067310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 286/596] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:18:01 2021] DELETE /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:18:02.077971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:02.078920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:02.087690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:02.088303 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:02.089218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:02.089778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:02.322746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:02.331863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9ab3f999-7b24-48f8-a524-e629005d47df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.258322 Apr 08 12:18:02.332914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 287/597] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:02 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:18:02.718560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-98b48b95-2317-4b46-af2b-2af06678a1d4 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.036609 Apr 08 12:18:02.721423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 311/598] 10.222.0.43 () {60 vars in 1145 bytes} [Thu Apr 8 12:18:01 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1040 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 08 12:18:02.733055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-39965137-fd84-4be2-9380-b7a56d525c5f tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22587eab70>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:02.895982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-39965137-fd84-4be2-9380-b7a56d525c5f tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266" status: 200 len: 346 microversion: 2.1 time: 0.166912 Apr 08 12:18:02.896704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 288/599] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:02 2021] GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266 => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:18:02.908843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-40153f4e-d806-40dc-9471-308dad675ac4 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Action: 'create', calling method: .version_select at 0x7f225880e1e0>, body: {"snapshot": {"volume_id": "496631d7-8889-4a90-815e-0c0226080266", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1783584759"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:02.986902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d1fc8be2-9dbb-4fde-b7b8-97599185b112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:02.995894 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d1fc8be2-9dbb-4fde-b7b8-97599185b112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:03.000400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d1fc8be2-9dbb-4fde-b7b8-97599185b112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:03.064281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d1fc8be2-9dbb-4fde-b7b8-97599185b112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Going to try to stop instance {{(pid=98474) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 08 12:18:03.230199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d1fc8be2-9dbb-4fde-b7b8-97599185b112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 202 len: 0 microversion: 2.1 time: 0.247231 Apr 08 12:18:03.230964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 289/600] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:18:02 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:18:03.240228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:03.241259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:03.249654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:03.250171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:03.251086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:03.251607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:03.286139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-40153f4e-d806-40dc-9471-308dad675ac4 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.380824 Apr 08 12:18:03.288962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 312/601] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 8 12:18:02 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:03.297331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-523ff900-a677-4500-a616-4283aa3b0594 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f225d90ab70>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:03.349874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-523ff900-a677-4500-a616-4283aa3b0594 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 200 len: 287 microversion: 2.1 time: 0.056251 Apr 08 12:18:03.351241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 313/602] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:03 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:03.356415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:03.357304 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:03.366030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:03.366737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:03.367719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:03.368239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:03.458237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:03.467725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-574f2401-0c8d-4ef6-8e4c-5f17a3609ffb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.231918 Apr 08 12:18:03.468357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 290/603] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:03 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:18:03.472956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-40db6977-5b23-4941-b0f5-7919d81ffe81 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22585e4840>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:03.520835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-40db6977-5b23-4941-b0f5-7919d81ffe81 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.051220 Apr 08 12:18:03.521476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 291/604] 10.222.0.43 () {58 vars in 1130 bytes} [Thu Apr 8 12:18:03 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:03.532836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-84719fd5-fff4-452a-af84-91f827ed6085 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22583d2378>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:03.575705 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:03.579970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-84719fd5-fff4-452a-af84-91f827ed6085 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 200 len: 287 microversion: 2.1 time: 0.051092 Apr 08 12:18:03.580659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 292/605] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:03 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:03.584907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7d9edf79-091d-44a0-bfd0-e9401dc0fe90 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.232432 Apr 08 12:18:03.586725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 314/606] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:03 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:04.486957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:04.487631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:04.497047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:04.497564 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:04.498438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:04.499197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:04.592395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-22aac18a-07e7-4730-b2c5-044c6b83f284 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22599a5b70>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:04.642839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-22aac18a-07e7-4730-b2c5-044c6b83f284 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 200 len: 287 microversion: 2.1 time: 0.054259 Apr 08 12:18:04.643472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 315/607] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:04 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:04.653113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:04.653800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:04.662494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:04.663622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:04.664504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:04.665007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:04.868631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:04.877883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-69b57f31-d0e7-4f72-8502-90304589ebcc tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.228868 Apr 08 12:18:04.878580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 316/608] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:04 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:04.916805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:04.925861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2b8450be-cec4-40c1-ba44-bb3d45f7fb3c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.442972 Apr 08 12:18:04.926548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 293/609] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:04 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:05.655724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-85d34522-d2fd-4a49-bc72-0562f5191664 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22585d9158>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:05.705871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-85d34522-d2fd-4a49-bc72-0562f5191664 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 200 len: 287 microversion: 2.1 time: 0.053985 Apr 08 12:18:05.706526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 317/610] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:05 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:05.894858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:05.895527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:05.904136 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:05.904648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:05.905480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:05.906008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:05.944255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:05.945067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:05.958290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:05.958290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:05.958290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:05.958290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:06.105423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:06.114451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-97b3e39f-d3f1-4ceb-b0c2-652f33dcf358 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.223632 Apr 08 12:18:06.115089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 294/611] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:05 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:06.158403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:06.167628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8db09a6c-2858-4ac2-b297-82fd82970552 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.227392 Apr 08 12:18:06.168243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 318/612] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:05 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:18:06.717740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-42126f9b-4bce-415a-a94c-edb9e9895d83 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f2259925c80>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:06.764002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-42126f9b-4bce-415a-a94c-edb9e9895d83 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 200 len: 287 microversion: 2.1 time: 0.050318 Apr 08 12:18:06.764628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 295/613] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:06 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:07.133804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:07.134510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:07.142530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:07.143052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:07.143902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:07.144403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:07.185893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:07.186635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:07.195274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:07.195792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:07.196641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:07.197149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:07.340403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:07.349575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-26ad3b01-103d-409d-9ef9-3c1e6c34f268 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.220438 Apr 08 12:18:07.350197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 319/614] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:07 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:07.393032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:07.402164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c9090796-5ae0-4884-bba1-3266794667b4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.220505 Apr 08 12:18:07.402834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 296/615] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:07 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:18:07.776891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7c9c3a11-4423-40da-bbcd-bdea094e7229 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f225880e6a8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:07.826182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7c9c3a11-4423-40da-bbcd-bdea094e7229 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 200 len: 288 microversion: 2.1 time: 0.053802 Apr 08 12:18:07.826932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 320/616] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:07 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 288 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:07.838567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bb0c8a42-3e32-48f6-bf43-0c02ba66f190 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22583d2268>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:08.033113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bb0c8a42-3e32-48f6-bf43-0c02ba66f190 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 202 len: 0 microversion: 2.1 time: 0.199211 Apr 08 12:18:08.033798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 297/617] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Apr 8 12:18:07 2021] DELETE /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:18:08.044020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-72c050ac-9d98-480b-b045-d8ad9237f3a2 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f225880e048>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:08.094900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-72c050ac-9d98-480b-b045-d8ad9237f3a2 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 200 len: 287 microversion: 2.1 time: 0.055023 Apr 08 12:18:08.095535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 321/618] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:08 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:08.368031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:08.368720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:08.376795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:08.377318 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:08.378164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:08.378697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:08.420297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:08.420979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:08.430501 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:08.431288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:08.432595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:08.433433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:08.649487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:08.658455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a17f6b1c-587d-4dc1-a1f9-813fc0e4ba99 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.242100 Apr 08 12:18:08.659082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 322/619] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:08 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:08.725067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817df72103284a328bb726b6989e405d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be091e02985d460c96e13347ab2ade1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:08.734398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c3bd5e23-85a3-42de-8189-ce91692fe649 tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 200 len: 1522 microversion: 2.1 time: 0.370377 Apr 08 12:18:08.735033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 298/620] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:08 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:08.871842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-db761167-c733-4790-8bbb-84212e8b1c32 req-4949eb02-93a2-4284-9234-766a5474ea60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63b515b-cd97-4a20-a16f-7b1f3eba4460", "name": "network-vif-deleted", "tag": "6bd89475-0e5a-4d22-a292-0f3eb6e0a648"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:08.873972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:18:08.873972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:18:08.883110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-db761167-c733-4790-8bbb-84212e8b1c32 req-4949eb02-93a2-4284-9234-766a5474ea60 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:08.883616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-db761167-c733-4790-8bbb-84212e8b1c32 req-4949eb02-93a2-4284-9234-766a5474ea60 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:08.901111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-db761167-c733-4790-8bbb-84212e8b1c32 req-4949eb02-93a2-4284-9234-766a5474ea60 service nova] Creating event network-vif-deleted:6bd89475-0e5a-4d22-a292-0f3eb6e0a648 for instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 on hv-cinder-78477 Apr 08 12:18:08.906155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-db761167-c733-4790-8bbb-84212e8b1c32 req-4949eb02-93a2-4284-9234-766a5474ea60 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041062 Apr 08 12:18:08.907063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 323/621] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:09.107994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f9d87e9a-696e-49e2-8467-aa02955acd5a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22587ea1e0>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:09.151211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-f9d87e9a-696e-49e2-8467-aa02955acd5a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] HTTP exception thrown: Snapshot 2cda81bd-6594-4eca-a909-c7969a0a5c4f could not be found. Apr 08 12:18:09.151971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f9d87e9a-696e-49e2-8467-aa02955acd5a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Returning 404 to user: Snapshot 2cda81bd-6594-4eca-a909-c7969a0a5c4f could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:09.152947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f9d87e9a-696e-49e2-8467-aa02955acd5a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f" status: 404 len: 111 microversion: 2.1 time: 0.049271 Apr 08 12:18:09.153636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 299/622] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:18:09 2021] GET /compute/v2.1/os-snapshots/2cda81bd-6594-4eca-a909-c7969a0a5c4f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:18:09.163058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7d17db29-c2cb-401e-918a-ca6e99a2dacb tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f225a2f0620>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:09.341683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7d17db29-c2cb-401e-918a-ca6e99a2dacb tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266" status: 202 len: 0 microversion: 2.1 time: 0.183113 Apr 08 12:18:09.342446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 324/623] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Apr 8 12:18:09 2021] DELETE /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:18:09.351101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-51986aa4-59df-48cc-89c6-d58250eee021 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22583d2488>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:09.456139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-51986aa4-59df-48cc-89c6-d58250eee021 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266" status: 200 len: 345 microversion: 2.1 time: 0.109062 Apr 08 12:18:09.456766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 300/624] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:09 2021] GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:09.676988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:09.677918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:09.686547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:09.687066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:09.687910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:09.688410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:09.753022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:09.753763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] [instance: d63b515b-cd97-4a20-a16f-7b1f3eba4460] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:09.762746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:09.763259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:09.764110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:09.764610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:09.823717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] HTTP exception thrown: Instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 could not be found. Apr 08 12:18:09.824401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] Returning 404 to user: Instance d63b515b-cd97-4a20-a16f-7b1f3eba4460 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:09.825319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fefea06c-fcaa-456e-9d32-3addb09400df tempest-ServerRescueNegativeTestJSON-826789939 tempest-ServerRescueNegativeTestJSON-826789939-project] 10.222.0.43 "GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460" status: 404 len: 111 microversion: 2.1 time: 0.076641 Apr 08 12:18:09.826123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 301/625] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:09 2021] GET /compute/v2.1/servers/d63b515b-cd97-4a20-a16f-7b1f3eba4460 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:18:10.035328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:10.044498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e6a5bdfe-453b-4a75-b804-89f4bca6bfb3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.371774 Apr 08 12:18:10.045130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 325/626] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:09 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:10.360507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:18:10.360741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:18:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:18:10.469392 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-127795d6-2f69-4c7c-87ec-c946d68f8504 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22583d2048>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:10.537823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-127795d6-2f69-4c7c-87ec-c946d68f8504 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] HTTP exception thrown: Volume 496631d7-8889-4a90-815e-0c0226080266 could not be found. Apr 08 12:18:10.538529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-127795d6-2f69-4c7c-87ec-c946d68f8504 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Returning 404 to user: Volume 496631d7-8889-4a90-815e-0c0226080266 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:10.539936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-127795d6-2f69-4c7c-87ec-c946d68f8504 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266" status: 404 len: 109 microversion: 2.1 time: 0.074508 Apr 08 12:18:10.540669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 302/627] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:10 2021] GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:18:10.551432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-69742e3d-4e55-4a1e-847c-62bfdcbbb40a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f225880e6a8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:10.618348 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-69742e3d-4e55-4a1e-847c-62bfdcbbb40a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] HTTP exception thrown: Volume 496631d7-8889-4a90-815e-0c0226080266 could not be found. Apr 08 12:18:10.619210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-69742e3d-4e55-4a1e-847c-62bfdcbbb40a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Returning 404 to user: Volume 496631d7-8889-4a90-815e-0c0226080266 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:10.620336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-69742e3d-4e55-4a1e-847c-62bfdcbbb40a tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266" status: 404 len: 109 microversion: 2.1 time: 0.073641 Apr 08 12:18:10.621143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 326/628] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Apr 8 12:18:10 2021] DELETE /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:18:10.629888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1d751aa2-557d-4e55-82ab-3b1c9a03f775 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Calling method '.version_select at 0x7f22585e4a60>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:10.696724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-1d751aa2-557d-4e55-82ab-3b1c9a03f775 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] HTTP exception thrown: Volume 496631d7-8889-4a90-815e-0c0226080266 could not be found. Apr 08 12:18:10.697482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1d751aa2-557d-4e55-82ab-3b1c9a03f775 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] Returning 404 to user: Volume 496631d7-8889-4a90-815e-0c0226080266 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:10.698539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1d751aa2-557d-4e55-82ab-3b1c9a03f775 tempest-VolumesSnapshotsTestJSON-1980184734 tempest-VolumesSnapshotsTestJSON-1980184734-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266" status: 404 len: 109 microversion: 2.1 time: 0.072778 Apr 08 12:18:10.699295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 303/629] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:10 2021] GET /compute/v2.1/os-volumes/496631d7-8889-4a90-815e-0c0226080266 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:18:11.066033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:11.066708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:11.076212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:11.076732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:11.077584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:11.078077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:11.768124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:11.777575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b1ef9df1-e9df-47bd-85c0-54249c63fef0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.716243 Apr 08 12:18:11.778184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 327/630] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:11 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:12.755233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1b2fb40b-b8af-4256-afc1-5593e5523531 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Action: 'create', calling method: .version_select at 0x7f22583d2268>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1745888852", "metadata": {"Type": "work"}}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:12.796011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:12.796692 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:12.816652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:12.817394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:12.818426 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:12.819076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:13.164287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:13.174987 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59ec1266-3eda-4b43-a921-975f43020070 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.382915 Apr 08 12:18:13.175716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 328/631] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:12 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:13.468517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1b2fb40b-b8af-4256-afc1-5593e5523531 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.842474 Apr 08 12:18:13.469760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 304/632] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Apr 8 12:18:12 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 844 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 08 12:18:13.482191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-67b0a548-c829-41b9-84c1-d348eba3a0f0 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Calling method '.version_select at 0x7f225880eb70>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:13.598622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-67b0a548-c829-41b9-84c1-d348eba3a0f0 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8" status: 200 len: 353 microversion: 2.1 time: 0.121228 Apr 08 12:18:13.599252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 329/633] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:13 2021] GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:14.193423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:14.194178 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:14.203444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:14.203967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:14.204889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:14.205581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:14.404560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:14.415678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d54f1b96-f521-4b9a-8b42-7dd455ce7d40 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.226320 Apr 08 12:18:14.416295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 305/634] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:14 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:14.612233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7f3be766-e7d5-4c6d-b32d-18117318b5c3 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Calling method '.version_select at 0x7f225d90a6a8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:14.712004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7f3be766-e7d5-4c6d-b32d-18117318b5c3 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8" status: 200 len: 353 microversion: 2.1 time: 0.102634 Apr 08 12:18:14.713048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 330/635] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:14 2021] GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:15.434505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:15.435314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:15.443737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:15.444250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:15.445147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:15.445643 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:15.725695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8f1f73e6-4c18-48da-aa18-1221aec033bf tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Calling method '.version_select at 0x7f225d90a8c8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:15.810641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:15.824238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0445d6a5-bf25-4b4a-8d94-23795dfb1578 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.393766 Apr 08 12:18:15.825280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 306/636] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:15 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:15.833778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8f1f73e6-4c18-48da-aa18-1221aec033bf tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8" status: 200 len: 354 microversion: 2.1 time: 0.112582 Apr 08 12:18:15.834703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 331/637] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:15 2021] GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:15.847383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b23b5700-4497-4d18-9783-47a9a33681be tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Calling method '.version_select at 0x7f225dc94d90>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:15.947585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b23b5700-4497-4d18-9783-47a9a33681be tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8" status: 200 len: 354 microversion: 2.1 time: 0.104701 Apr 08 12:18:15.948421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 307/638] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:15 2021] GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:15.961261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e1aac17c-e50b-4236-b52d-b22bb5adb17a tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Calling method '.version_select at 0x7f22587c48c8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:16.128011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e1aac17c-e50b-4236-b52d-b22bb5adb17a tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8" status: 202 len: 0 microversion: 2.1 time: 0.169287 Apr 08 12:18:16.129063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 332/639] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Apr 8 12:18:15 2021] DELETE /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:18:16.138816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aa8a04da-7f06-4128-bc1b-25551bdf99e9 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Calling method '.version_select at 0x7f2259925158>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:16.247256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aa8a04da-7f06-4128-bc1b-25551bdf99e9 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8" status: 200 len: 353 microversion: 2.1 time: 0.112782 Apr 08 12:18:16.248008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 308/640] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:16 2021] GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8 => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:16.843047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:16.843836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:16.852725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:16.853236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:16.854080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:16.854600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:17.052283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:17.061089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fc4ea4aa-517c-420d-8e58-35a64c8916ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.222102 Apr 08 12:18:17.061711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 333/641] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:16 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:17.261261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3800669f-8904-4326-b660-72b3c8524749 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Calling method '.version_select at 0x7f22587ead08>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:17.326177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-3800669f-8904-4326-b660-72b3c8524749 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] HTTP exception thrown: Volume 462ba927-b33e-45cf-96dc-8a7a4c6af6a8 could not be found. Apr 08 12:18:17.326931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3800669f-8904-4326-b660-72b3c8524749 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] Returning 404 to user: Volume 462ba927-b33e-45cf-96dc-8a7a4c6af6a8 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:17.327838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3800669f-8904-4326-b660-72b3c8524749 tempest-VolumesGetTestJSON-1361977869 tempest-VolumesGetTestJSON-1361977869-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8" status: 404 len: 109 microversion: 2.1 time: 0.071385 Apr 08 12:18:17.328441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 309/642] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:17 2021] GET /compute/v2.1/os-volumes/462ba927-b33e-45cf-96dc-8a7a4c6af6a8 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:18:18.082886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:18.083594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:18.093227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:18.093838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:18.094822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:18.095392 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:18.351708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:18.360944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d2c526b9-33f6-440b-87d5-c296295b2b76 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1676 microversion: 2.1 time: 0.283830 Apr 08 12:18:18.361578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 334/643] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:18 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1676 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:19.321481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ea5d2635-4219-4197-8ada-cb0b828a8879 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Action: 'create', calling method: .version_select at 0x7f225a934d08>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-971435828", "metadata": {"Type": "work"}}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:19.322441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ea5d2635-4219-4197-8ada-cb0b828a8879 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:19.323317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ea5d2635-4219-4197-8ada-cb0b828a8879 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136624 Apr 08 12:18:19.328483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 310/644] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Apr 8 12:18:19 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 12:18:19.333552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-447cae18-3549-46e1-90d3-f477637ece07 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Action: 'create', calling method: .version_select at 0x7f22599b6d90>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1787967768", "metadata": {"Type": "work"}}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:19.335294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-447cae18-3549-46e1-90d3-f477637ece07 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:19.336837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-447cae18-3549-46e1-90d3-f477637ece07 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007254 Apr 08 12:18:19.337435 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 335/645] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Apr 8 12:18:19 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 12:18:19.346834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-badf68b5-d316-4128-8d0e-5a9fd0f87b7a tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Action: 'create', calling method: .version_select at 0x7f22585e4ae8>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1012165879", "metadata": {"Type": "work"}}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:19.348592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-badf68b5-d316-4128-8d0e-5a9fd0f87b7a tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:19.349461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-badf68b5-d316-4128-8d0e-5a9fd0f87b7a tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006951 Apr 08 12:18:19.350018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 311/646] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Apr 8 12:18:19 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 12:18:19.359336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f9e02ce0-b6df-4a40-8bb8-e0830119870d tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Calling method '.version_select at 0x7f225d90a598>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:19.381885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:19.383468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:19.391862 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:19.392389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:19.393249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:19.393761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:19.506102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-f9e02ce0-b6df-4a40-8bb8-e0830119870d tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] HTTP exception thrown: Volume tempest-invalid-1559344213 could not be found. Apr 08 12:18:19.507037 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f9e02ce0-b6df-4a40-8bb8-e0830119870d tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Returning 404 to user: Volume tempest-invalid-1559344213 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:19.510132 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f9e02ce0-b6df-4a40-8bb8-e0830119870d tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1559344213" status: 404 len: 99 microversion: 2.1 time: 0.154408 Apr 08 12:18:19.516033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 336/647] 10.222.0.43 () {58 vars in 1208 bytes} [Thu Apr 8 12:18:19 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1559344213 => generated 99 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 08 12:18:19.522104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d5d5823e-0578-4bc7-a025-049586d7afc5 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003751 Apr 08 12:18:19.532400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 337/648] 10.222.0.43 () {58 vars in 1130 bytes} [Thu Apr 8 12:18:19 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 08 12:18:19.537658 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-19405273-5a10-4de7-a2f1-08a6a4564477 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003885 Apr 08 12:18:19.538219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 338/649] 10.222.0.43 () {58 vars in 1127 bytes} [Thu Apr 8 12:18:19 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 08 12:18:19.550885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-95179f87-219f-4a73-a745-1ef9a32856a7 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Calling method '.version_select at 0x7f225880e0d0>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:19.650565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:19.657795 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-92b54b37-b45e-4084-a974-1c3ee4fb5b5a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1653 microversion: 2.1 time: 0.281838 Apr 08 12:18:19.658401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-95179f87-219f-4a73-a745-1ef9a32856a7 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] HTTP exception thrown: Volume 248ed0cb-8660-499e-b171-4c51f5752a11 could not be found. Apr 08 12:18:19.658539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 312/650] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:19 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1653 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:18:19.659083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-95179f87-219f-4a73-a745-1ef9a32856a7 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Returning 404 to user: Volume 248ed0cb-8660-499e-b171-4c51f5752a11 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:19.660009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-95179f87-219f-4a73-a745-1ef9a32856a7 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/248ed0cb-8660-499e-b171-4c51f5752a11" status: 404 len: 109 microversion: 2.1 time: 0.114612 Apr 08 12:18:19.660601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 339/651] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Apr 8 12:18:19 2021] DELETE /compute/v2.1/os-volumes/248ed0cb-8660-499e-b171-4c51f5752a11 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:18:19.670692 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6b74d18e-beb9-4765-8a14-dcce538a5207 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Calling method '.version_select at 0x7f22587f32f0>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:19.675546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0b21f788-ac37-4ed1-9cfa-e6c4cf0ee984 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:19.685456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0b21f788-ac37-4ed1-9cfa-e6c4cf0ee984 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:19.686093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0b21f788-ac37-4ed1-9cfa-e6c4cf0ee984 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:19.739261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-6b74d18e-beb9-4765-8a14-dcce538a5207 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] HTTP exception thrown: Volume 268444dd-1790-49a1-aba9-b58dbac45f7b could not be found. Apr 08 12:18:19.740058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6b74d18e-beb9-4765-8a14-dcce538a5207 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] Returning 404 to user: Volume 268444dd-1790-49a1-aba9-b58dbac45f7b could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:19.740979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6b74d18e-beb9-4765-8a14-dcce538a5207 tempest-VolumesNegativeTest-1450829536 tempest-VolumesNegativeTest-1450829536-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/268444dd-1790-49a1-aba9-b58dbac45f7b" status: 404 len: 109 microversion: 2.1 time: 0.074358 Apr 08 12:18:19.741854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 313/652] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:19 2021] GET /compute/v2.1/os-volumes/268444dd-1790-49a1-aba9-b58dbac45f7b => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:18:19.747329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0b21f788-ac37-4ed1-9cfa-e6c4cf0ee984 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Going to try to start instance {{(pid=98473) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 08 12:18:19.904046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0b21f788-ac37-4ed1-9cfa-e6c4cf0ee984 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action" status: 202 len: 0 microversion: 2.1 time: 0.232213 Apr 08 12:18:19.904711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 340/653] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:18:19 2021] POST /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:18:19.913269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:19.914570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:19.923218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:19.923732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:19.924573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:19.925071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:20.180155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:20.189383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-89ba4247-7aca-462e-9cc2-9e08a24e6a18 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1662 microversion: 2.1 time: 0.280045 Apr 08 12:18:20.190251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 314/654] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:19 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1662 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:20.711265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6c844895-03f9-436c-be90-833bad990033 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f22585d9c80>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:20.841517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6c844895-03f9-436c-be90-833bad990033 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/293500e7-59b3-4fe3-b179-7ced678216ac" status: 200 len: 350 microversion: 2.1 time: 0.134952 Apr 08 12:18:20.842134 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 341/655] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:20 2021] GET /compute/v2.1/os-volumes/293500e7-59b3-4fe3-b179-7ced678216ac => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:21.209215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:21.213554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:21.218191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:21.218821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:21.219744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:21.220320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:21.555348 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:21.570428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fd0de9b1-26e6-4a6b-9017-313c66bd5523 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1662 microversion: 2.1 time: 0.364608 Apr 08 12:18:21.577680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 315/656] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:21 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1662 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:22.573138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a9939b74-acee-4065-95aa-5401dd908062 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f225880ee18>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:22.590062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:22.590777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:22.598605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:22.599307 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:22.600327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:22.601016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:22.704891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a9939b74-acee-4065-95aa-5401dd908062 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/4936ca3b-2c42-4a8b-ae40-1ee86042b240" status: 200 len: 350 microversion: 2.1 time: 0.136771 Apr 08 12:18:22.705516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 342/657] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:22 2021] GET /compute/v2.1/os-volumes/4936ca3b-2c42-4a8b-ae40-1ee86042b240 => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:22.818486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:22.828648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c9c60399-9952-4860-8761-6020cf86207e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1666 microversion: 2.1 time: 0.243312 Apr 08 12:18:22.829278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 316/658] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:18:22 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1666 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:24.509434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c2009264-1ce5-4f6d-a42c-8aae16333f9e tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f225880ebf8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:24.613452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c2009264-1ce5-4f6d-a42c-8aae16333f9e tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/18cc6b6b-46a8-44a9-9a9f-7ddf742e48ad" status: 200 len: 351 microversion: 2.1 time: 0.108733 Apr 08 12:18:24.614156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 343/659] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Apr 8 12:18:24 2021] GET /compute/v2.1/os-volumes/18cc6b6b-46a8-44a9-9a9f-7ddf742e48ad => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:24.627639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f225dc13-8abd-443f-b9d5-b11bf5b9a349 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f22585e4d90>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:24.717441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f225dc13-8abd-443f-b9d5-b11bf5b9a349 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094098 Apr 08 12:18:24.718086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 317/660] 10.222.0.43 () {58 vars in 1124 bytes} [Thu Apr 8 12:18:24 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:24.731074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c0321a01-b4be-4086-94d2-464570073d47 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f225880e510>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:24.823712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c0321a01-b4be-4086-94d2-464570073d47 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096474 Apr 08 12:18:24.824639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 344/661] 10.222.0.43 () {58 vars in 1139 bytes} [Thu Apr 8 12:18:24 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:24.838878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f0653492-2e87-4dc6-8432-69a3228cb31f tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f22587f3730>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:24.932214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f0653492-2e87-4dc6-8432-69a3228cb31f tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098238 Apr 08 12:18:24.933262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 318/662] 10.222.0.43 () {58 vars in 1124 bytes} [Thu Apr 8 12:18:24 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:24.946056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7ae3d9d1-c702-4d47-ad4f-6ddec46fb000 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f225d90a8c8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:25.041174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7ae3d9d1-c702-4d47-ad4f-6ddec46fb000 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099715 Apr 08 12:18:25.041893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 345/663] 10.222.0.43 () {58 vars in 1157 bytes} [Thu Apr 8 12:18:24 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:25.055235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-869c7092-831d-46b2-9b94-1f40a5c25c9e tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f2258374c80>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:25.152396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-869c7092-831d-46b2-9b94-1f40a5c25c9e tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.101987 Apr 08 12:18:25.153139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 319/664] 10.222.0.43 () {58 vars in 1160 bytes} [Thu Apr 8 12:18:25 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:25.166351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-688b153c-9091-487d-a3ec-461f49f8079c tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f22587ad048>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:25.255871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-688b153c-9091-487d-a3ec-461f49f8079c tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093969 Apr 08 12:18:25.256507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 346/665] 10.222.0.43 () {58 vars in 1145 bytes} [Thu Apr 8 12:18:25 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:25.269754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b9b1581f-f660-4eed-93f8-3f23a9ad2e6c tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f22587f39d8>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:25.362271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b9b1581f-f660-4eed-93f8-3f23a9ad2e6c tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096535 Apr 08 12:18:25.363049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 320/666] 10.222.0.43 () {58 vars in 1178 bytes} [Thu Apr 8 12:18:25 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:25.376394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ce7a7d07-928b-432f-bc72-c88d58f73598 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] Calling method '.version_select at 0x7f22587c48c8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:25.478206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ce7a7d07-928b-432f-bc72-c88d58f73598 tempest-VolumesTestJSON-1867296047 tempest-VolumesTestJSON-1867296047-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.105978 Apr 08 12:18:25.478886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 347/667] 10.222.0.43 () {58 vars in 1145 bytes} [Thu Apr 8 12:18:25 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:18:35.438244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-93c94664-a7fc-4d3e-a9c5-879cdd44297e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:35.438808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-93c94664-a7fc-4d3e-a9c5-879cdd44297e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:35.447450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c94664-a7fc-4d3e-a9c5-879cdd44297e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:35.447979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c94664-a7fc-4d3e-a9c5-879cdd44297e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:35.448837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c94664-a7fc-4d3e-a9c5-879cdd44297e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:35.449347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93c94664-a7fc-4d3e-a9c5-879cdd44297e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:35.520352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-93c94664-a7fc-4d3e-a9c5-879cdd44297e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-volume_attachments/6459f955-541d-42e7-9a5c-bae11053a857" status: 200 len: 194 microversion: 2.20 time: 0.086078 Apr 08 12:18:35.521017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 321/668] 10.222.0.43 () {60 vars in 1444 bytes} [Thu Apr 8 12:18:35 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-volume_attachments/6459f955-541d-42e7-9a5c-bae11053a857 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:18:35.641777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:35.642499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:35.651481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:35.652000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:35.652843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:35.653390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:35.833214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lazy-loading 'services' on Instance uuid 704586d7-ad35-414f-af0c-5835b542f260 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:18:36.048151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f11874bd-2518-4786-a0bd-c940c7788d62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-volume_attachments/6459f955-541d-42e7-9a5c-bae11053a857" status: 202 len: 0 microversion: 2.20 time: 0.410189 Apr 08 12:18:36.048811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 348/669] 10.222.0.43 () {60 vars in 1447 bytes} [Thu Apr 8 12:18:35 2021] DELETE /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260/os-volume_attachments/6459f955-541d-42e7-9a5c-bae11053a857 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:18:37.296831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:37.297382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:37.305944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:37.306201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:37.307096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:37.307592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:37.376210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:18:37.619912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a07d1501-ec6c-44fb-9844-1ec5fbe75402 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 204 len: 0 microversion: 2.20 time: 0.326803 Apr 08 12:18:37.620562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 322/670] 10.222.0.43 () {60 vars in 1270 bytes} [Thu Apr 8 12:18:37 2021] DELETE /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 12:18:37.634753 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:37.635530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:37.644553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:37.645074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:37.645930 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:37.646585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:37.854281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:37.863963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:37.865640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:37.867378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-981bfae1-0c5e-47df-a5cf-9f1d88af3e49 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.237969 Apr 08 12:18:37.867990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 349/671] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:37 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:38.888568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:38.889349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:38.897852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:38.898504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:38.899377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:38.900136 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:39.104461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:39.115091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:39.117354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:39.118654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-de1fc752-3c87-47fb-8e5d-c1e8ade35fb7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.234736 Apr 08 12:18:39.119244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 323/672] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:38 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:40.140995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:40.142010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:40.150943 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:40.151533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:40.152440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:40.152941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:40.359534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:40.369629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:40.371306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:40.372880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e237d94c-2f66-41fb-ac53-1f7b42615997 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.236560 Apr 08 12:18:40.373360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 350/673] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:40 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:41.392629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:41.393951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:41.409587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:41.410101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:41.410988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:41.411487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:41.810713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:41.822579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:41.824476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:41.825857 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f91e5ae6-80eb-49c4-8bd2-7e119ba39afe tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1723 microversion: 2.20 time: 0.437409 Apr 08 12:18:41.826582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 324/674] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:41 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:42.847026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:42.847689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:42.857176 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:42.857690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:42.858930 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:42.859424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:43.069346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-2dd77c5b-d795-4936-8f03-376b8349fbe3 req-9d18c9da-4631-4d05-942e-83dde73d7130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704586d7-ad35-414f-af0c-5835b542f260", "name": "network-vif-deleted", "tag": "53f6e72e-034c-4c1c-be6e-8d0a69255cf0"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:43.072297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:18:43.072297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:18:43.082844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-2dd77c5b-d795-4936-8f03-376b8349fbe3 req-9d18c9da-4631-4d05-942e-83dde73d7130 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:43.083597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-2dd77c5b-d795-4936-8f03-376b8349fbe3 req-9d18c9da-4631-4d05-942e-83dde73d7130 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:43.105050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-2dd77c5b-d795-4936-8f03-376b8349fbe3 req-9d18c9da-4631-4d05-942e-83dde73d7130 service nova] Creating event network-vif-deleted:53f6e72e-034c-4c1c-be6e-8d0a69255cf0 for instance 704586d7-ad35-414f-af0c-5835b542f260 on hv-cinder-78477 Apr 08 12:18:43.111322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-2dd77c5b-d795-4936-8f03-376b8349fbe3 req-9d18c9da-4631-4d05-942e-83dde73d7130 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046273 Apr 08 12:18:43.112642 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 325/675] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:18:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:18:43.362897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:43.374844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:43.376841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:43.393619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0517a5a7-859c-4c3f-9a99-74998fb50a4c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 200 len: 1656 microversion: 2.20 time: 0.536716 Apr 08 12:18:43.393619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 351/676] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:42 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 1656 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:44.413448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:44.414236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:44.436511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:44.439750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:44.440858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:44.446967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:44.529237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] HTTP exception thrown: Instance 704586d7-ad35-414f-af0c-5835b542f260 could not be found. Apr 08 12:18:44.529899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Returning 404 to user: Instance 704586d7-ad35-414f-af0c-5835b542f260 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:18:44.531031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e529c48f-1d88-4c9a-987a-de856dc9cf6f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 404 len: 111 microversion: 2.20 time: 0.123153 Apr 08 12:18:44.531815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 326/677] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:44 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 12:18:44.542144 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5eba6554-6b45-456e-844b-a5e451fbeb1d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '.version_select at 0x7f225880e0d0>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:44.604698 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5eba6554-6b45-456e-844b-a5e451fbeb1d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139061042" status: 204 len: 0 microversion: 2.20 time: 0.067696 Apr 08 12:18:44.605699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 352/678] 10.222.0.43 () {60 vars in 1252 bytes} [Thu Apr 8 12:18:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139061042 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 12:18:46.359414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-28c23426-7f6c-4906-86a9-f2d6f453ba47 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'create', calling method: .version_select at 0x7f2258374268>, body: {"keypair": {"name": "tempest-keypair-424360264"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:46.389582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-28c23426-7f6c-4906-86a9-f2d6f453ba47 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:18:46.394458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-28c23426-7f6c-4906-86a9-f2d6f453ba47 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for user 003e0d5d02fb4268a1122538eb880dd5 and project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:18:46.893454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-28c23426-7f6c-4906-86a9-f2d6f453ba47 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:18:46.899031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-28c23426-7f6c-4906-86a9-f2d6f453ba47 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for user 003e0d5d02fb4268a1122538eb880dd5 and project d8fb1b381792465a82ef64be541e5500. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:18:46.916092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-28c23426-7f6c-4906-86a9-f2d6f453ba47 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.563153 Apr 08 12:18:46.916778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 327/679] 10.222.0.43 () {62 vars in 1189 bytes} [Thu Apr 8 12:18:46 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 565 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 08 12:18:50.028779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-3989841", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "869b82a0-8157-44c7-88c1-711d14519eb3"}], "security_groups": [{"name": "tempest-securitygroup--713428170"}], "key_name": "tempest-keypair-424360264", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:50.294529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] validate_networks() for [('869b82a0-8157-44c7-88c1-711d14519eb3', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:18:51.801700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:18:51.802366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:18:51.803423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:18:51.804233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:18:51.804913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:18:51.814407 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:51.815024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:51.816051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:51.816649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:51.841107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for project d8fb1b381792465a82ef64be541e5500. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:18:51.845901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Getting quotas for user 003e0d5d02fb4268a1122538eb880dd5 and project d8fb1b381792465a82ef64be541e5500. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:18:51.858239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:18:51.861060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:18:51.977540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-934255fd-ed5f-4d16-9974-bc9a94fe924e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.952689 Apr 08 12:18:51.982711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 353/680] 10.222.0.43 () {62 vars in 1178 bytes} [Thu Apr 8 12:18:50 2021] POST /compute/v2.1/servers => generated 401 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 08 12:18:51.994163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-37776a87-966b-4e76-87c3-330ed45e1342 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:51.995737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-37776a87-966b-4e76-87c3-330ed45e1342 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:52.133203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37776a87-966b-4e76-87c3-330ed45e1342 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:52.160752 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37776a87-966b-4e76-87c3-330ed45e1342 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:52.173499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37776a87-966b-4e76-87c3-330ed45e1342 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:52.174935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-37776a87-966b-4e76-87c3-330ed45e1342 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1278 microversion: 2.20 time: 0.185312 Apr 08 12:18:52.175738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 328/681] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:51 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:53.194337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:53.195275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:53.205763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:53.206398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:53.207341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:53.207931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:53.376424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:53.386952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:53.388668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:53.390043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6ed25a3a-4c27-4d64-aaf9-17b36084820f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1282 microversion: 2.20 time: 0.200278 Apr 08 12:18:53.390764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 354/682] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:53 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:54.412784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:54.413452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:54.430070 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:54.430612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:54.431479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:54.431973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:54.594714 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:54.604912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:54.606918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:54.608193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dab8c2b0-efa6-4041-b72e-74ed12a20454 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1348 microversion: 2.20 time: 0.199508 Apr 08 12:18:54.608905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 329/683] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:54 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1348 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:55.629059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:55.630493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:55.639159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:55.639605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:55.640629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:55.641122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:55.779422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:55.790246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:55.792001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:55.793169 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3aaabc7a-c4a5-48ea-bca0-1b0b599aaa74 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1336 microversion: 2.20 time: 0.168192 Apr 08 12:18:55.794114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 355/684] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:55 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1336 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:56.815621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:56.815621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:56.822204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:56.822758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:56.823627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:56.824131 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:57.611378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:57.621530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:57.623237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:57.624677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9e38f6f5-d8fc-438a-adce-32004415122f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.815950 Apr 08 12:18:57.625289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 330/685] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:56 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:18:58.643583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:18:58.644256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:18:58.652931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:58.653444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:58.654291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:58.654861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:58.957205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:58.976798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:58.979252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:18:58.981023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2e177b20-e7ca-4819-ae85-4213615e4404 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.341512 Apr 08 12:18:58.981817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 356/686] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:58 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:18:59.377765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d455ac99-718c-4e1e-8aa0-409b6fbe556b req-2476b39b-8664-453e-a927-34ccb177ef4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dd2b74-811a-48ae-b536-083c33d13d45", "tag": "fb2e14a6-43f6-49b1-b7b3-9f9fb1687767"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:18:59.379520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:18:59.379520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:18:59.399084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d455ac99-718c-4e1e-8aa0-409b6fbe556b req-2476b39b-8664-453e-a927-34ccb177ef4d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:18:59.400369 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d455ac99-718c-4e1e-8aa0-409b6fbe556b req-2476b39b-8664-453e-a927-34ccb177ef4d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:18:59.483072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d455ac99-718c-4e1e-8aa0-409b6fbe556b req-2476b39b-8664-453e-a927-34ccb177ef4d service nova] Creating event network-changed:fb2e14a6-43f6-49b1-b7b3-9f9fb1687767 for instance c3dd2b74-811a-48ae-b536-083c33d13d45 on hv-cinder-78477 Apr 08 12:18:59.496023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d455ac99-718c-4e1e-8aa0-409b6fbe556b req-2476b39b-8664-453e-a927-34ccb177ef4d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122307 Apr 08 12:18:59.496871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 331/687] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:18:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:00.000326 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:00.000895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:00.009450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:00.009932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:00.010827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:00.011395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:00.435288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:00.449708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:00.451890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:00.453327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e7bb313a-71a0-465e-8d9f-6f468fb9111e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.457585 Apr 08 12:19:00.454131 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 357/688] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:18:59 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:01.475107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:01.476772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:01.487789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:01.488521 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:01.489606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:01.490822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:01.874982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:01.890416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:01.900349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:01.901844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-86cff580-fc48-451e-8848-44375eb55abb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.432179 Apr 08 12:19:01.903059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 332/689] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:01 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:02.921547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:02.922227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:02.932997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:02.933845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:02.934811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:02.935318 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:03.330234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:03.340743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:03.342733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:03.344065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1874ec39-0d95-4437-9b59-70ad30977ed2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.426824 Apr 08 12:19:03.345155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 358/690] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:02 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:04.365763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:04.368406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:04.377400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:04.377933 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:04.409681 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:04.410198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:05.001092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:05.013004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:05.014773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:05.016010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-525f0c13-6250-4cc0-b5d4-6f1614a9c443 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.655821 Apr 08 12:19:05.016876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 333/691] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:04 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:06.038422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:06.039148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:06.047908 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:06.048647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:06.049644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:06.050282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:06.270502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:06.281998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:06.283876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:06.285573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6046ba88-c187-4f31-84bd-4f67a95980f0 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.253881 Apr 08 12:19:06.286411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 359/692] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:06 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:07.305855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:07.306565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:07.316107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:07.316618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:07.317474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:07.318674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:07.524092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-87307f19-a68d-4ee0-a238-18ac059603fb tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Action: 'create', calling method: .version_select at 0x7f22587ea2f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-366820502"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:07.548734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-87307f19-a68d-4ee0-a238-18ac059603fb tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Getting quotas for project f89c54d8444949e0a136701bbc6c6577. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:19:07.554379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-87307f19-a68d-4ee0-a238-18ac059603fb tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Getting quotas for user 0c7678801cc44322b9ac950e68ee5cc0 and project f89c54d8444949e0a136701bbc6c6577. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:19:07.558699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:07.570278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:07.572724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:07.574027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-003cc5e7-ad5d-4c3f-9079-536201ecc40b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.272816 Apr 08 12:19:07.574659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 360/693] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:07 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:07.787146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-87307f19-a68d-4ee0-a238-18ac059603fb tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Getting quotas for project f89c54d8444949e0a136701bbc6c6577. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:19:07.791197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-87307f19-a68d-4ee0-a238-18ac059603fb tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Getting quotas for user 0c7678801cc44322b9ac950e68ee5cc0 and project f89c54d8444949e0a136701bbc6c6577. Resources: {'key_pairs'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:19:07.805184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-87307f19-a68d-4ee0-a238-18ac059603fb tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.509907 Apr 08 12:19:07.806063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 334/694] 10.222.0.43 () {60 vars in 1148 bytes} [Thu Apr 8 12:19:07 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:08.595960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:08.597710 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:08.608597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:08.609310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:08.610699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:08.612140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:08.869876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:08.880613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:08.883045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:08.884355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fba17515-d4f5-4f2e-ad95-01baf302f5b6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.293090 Apr 08 12:19:08.885226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 361/695] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:08 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:08.983257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-8e2849fa-d30b-4ce3-9e37-65542ddc5291 req-5ccd02dc-ee30-4cb6-b2ab-b508bb89dcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dd2b74-811a-48ae-b536-083c33d13d45", "name": "network-vif-plugged", "status": "completed", "tag": "fb2e14a6-43f6-49b1-b7b3-9f9fb1687767"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:08.985354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:08.985354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:09.000202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-8e2849fa-d30b-4ce3-9e37-65542ddc5291 req-5ccd02dc-ee30-4cb6-b2ab-b508bb89dcac service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:09.000730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-8e2849fa-d30b-4ce3-9e37-65542ddc5291 req-5ccd02dc-ee30-4cb6-b2ab-b508bb89dcac service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:09.006032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:09.006802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:09.015670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:09.016452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:09.018225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:09.018647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:09.018846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-8e2849fa-d30b-4ce3-9e37-65542ddc5291 req-5ccd02dc-ee30-4cb6-b2ab-b508bb89dcac service nova] Creating event network-vif-plugged:fb2e14a6-43f6-49b1-b7b3-9f9fb1687767 for instance c3dd2b74-811a-48ae-b536-083c33d13d45 on hv-cinder-78477 Apr 08 12:19:09.024435 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-8e2849fa-d30b-4ce3-9e37-65542ddc5291 req-5ccd02dc-ee30-4cb6-b2ab-b508bb89dcac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045200 Apr 08 12:19:09.025079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 335/696] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:09.100935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:19:09.306193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e22c2098-0b9a-47a5-ac0f-02419639a1c1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 204 len: 0 microversion: 2.1 time: 0.305254 Apr 08 12:19:09.306986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 362/697] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:19:08 2021] DELETE /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:19:09.316550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:09.317432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:09.328509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:09.329115 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:09.330133 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:09.330729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:09.539175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:09.547983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d787aa67-f7cb-4954-acdd-eb57c25e488a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1672 microversion: 2.1 time: 0.236122 Apr 08 12:19:09.548619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 336/698] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:09 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:09.904078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:09.904852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:09.912767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:09.913286 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:09.914116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:09.914815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:10.160396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:10.172193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:10.173893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:10.175135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-623e4242-5ca5-487d-be05-c7880e847a9c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1403 microversion: 2.20 time: 0.275574 Apr 08 12:19:10.175973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 363/699] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:09 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1403 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:10.567160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:10.568207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:10.576663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:10.577269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:10.578393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:10.578897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:10.819530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:10.828460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b263204e-a868-4ca2-a7dd-67167c74ee88 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1672 microversion: 2.1 time: 0.265401 Apr 08 12:19:10.829075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 337/700] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:10 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1672 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:11.196511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:11.197188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:11.205812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:11.206340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:11.207192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:11.207680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:11.425974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:11.436790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:11.438736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:11.440121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-29fa7ec2-5e84-42c5-b104-8579ee98dec8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1595 microversion: 2.20 time: 0.249477 Apr 08 12:19:11.441220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 364/701] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:11 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1595 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:11.459985 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-377dcdd4-e72c-43e5-be12-4aab392cfeaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:11.460914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-377dcdd4-e72c-43e5-be12-4aab392cfeaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:11.469626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-377dcdd4-e72c-43e5-be12-4aab392cfeaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:11.470583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-377dcdd4-e72c-43e5-be12-4aab392cfeaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:11.471677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-377dcdd4-e72c-43e5-be12-4aab392cfeaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:11.472410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-377dcdd4-e72c-43e5-be12-4aab392cfeaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:11.848204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:11.849447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:11.857670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:11.858187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:11.859108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:11.859609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:12.072260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:12.082622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-39549677-0b21-4389-a515-14f1b0da0498 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1672 microversion: 2.1 time: 0.238561 Apr 08 12:19:12.083627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 365/702] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:11 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:12.106805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-377dcdd4-e72c-43e5-be12-4aab392cfeaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.650105 Apr 08 12:19:12.107722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 338/703] 10.222.0.43 () {60 vars in 1306 bytes} [Thu Apr 8 12:19:11 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/os-interface => generated 284 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:13.102880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:13.104721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:13.115527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:13.115859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:13.117105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:13.117569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:13.325160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:13.337641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-236e36b2-7e3a-43cf-af97-7a36388a92b1 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1604 microversion: 2.1 time: 0.240115 Apr 08 12:19:13.338428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 366/704] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:13 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:13.629388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-9f622e95-73dc-4f7d-a7cf-4f57011c5ba8 req-01740ecf-f0e4-4e56-900b-3d4fe504e288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5318a0d2-3723-47d4-9ec0-700cbb4cab5b", "name": "network-vif-deleted", "tag": "f711e7c2-6722-4058-8a3c-5703f7eafe86"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:13.632374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:13.632374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:13.647149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9f622e95-73dc-4f7d-a7cf-4f57011c5ba8 req-01740ecf-f0e4-4e56-900b-3d4fe504e288 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:13.647676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9f622e95-73dc-4f7d-a7cf-4f57011c5ba8 req-01740ecf-f0e4-4e56-900b-3d4fe504e288 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:13.671323 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-9f622e95-73dc-4f7d-a7cf-4f57011c5ba8 req-01740ecf-f0e4-4e56-900b-3d4fe504e288 service nova] Creating event network-vif-deleted:f711e7c2-6722-4058-8a3c-5703f7eafe86 for instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b on hv-cinder-78477 Apr 08 12:19:13.681174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-9f622e95-73dc-4f7d-a7cf-4f57011c5ba8 req-01740ecf-f0e4-4e56-900b-3d4fe504e288 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055606 Apr 08 12:19:13.682822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 339/705] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:14.356430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:14.357940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:14.368250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:14.369039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:14.370563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:14.371283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:14.495284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:14.495877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:14.498837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lazy-loading 'fault' on Instance uuid 5318a0d2-3723-47d4-9ec0-700cbb4cab5b {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:19:14.634749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-11a2337f-9473-4fff-80d1-bcf9a195bf5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:14.636129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:14.636997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-11a2337f-9473-4fff-80d1-bcf9a195bf5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:14.647097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11a2337f-9473-4fff-80d1-bcf9a195bf5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:14.647839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-00b37b9a-c3d6-4485-a1ba-c3b048f1b355 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 200 len: 1326 microversion: 2.1 time: 0.295473 Apr 08 12:19:14.648263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11a2337f-9473-4fff-80d1-bcf9a195bf5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:14.648828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 367/706] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:14 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 1326 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:14.649593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11a2337f-9473-4fff-80d1-bcf9a195bf5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:14.650288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-11a2337f-9473-4fff-80d1-bcf9a195bf5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:14.654336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-ac5c9697-8988-4e8d-aac7-198cf989fcb6 req-36151901-29b7-4c03-800d-3497f27affe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dd2b74-811a-48ae-b536-083c33d13d45", "tag": "fb2e14a6-43f6-49b1-b7b3-9f9fb1687767"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:14.656202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:14.656202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:14.667724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ac5c9697-8988-4e8d-aac7-198cf989fcb6 req-36151901-29b7-4c03-800d-3497f27affe8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:14.668433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ac5c9697-8988-4e8d-aac7-198cf989fcb6 req-36151901-29b7-4c03-800d-3497f27affe8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:14.700628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-ac5c9697-8988-4e8d-aac7-198cf989fcb6 req-36151901-29b7-4c03-800d-3497f27affe8 service nova] Creating event network-changed:fb2e14a6-43f6-49b1-b7b3-9f9fb1687767 for instance c3dd2b74-811a-48ae-b536-083c33d13d45 on hv-cinder-78477 Apr 08 12:19:14.706566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-ac5c9697-8988-4e8d-aac7-198cf989fcb6 req-36151901-29b7-4c03-800d-3497f27affe8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055479 Apr 08 12:19:14.707237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 368/707] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:14.781274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-11a2337f-9473-4fff-80d1-bcf9a195bf5a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.152147 Apr 08 12:19:14.784966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 340/708] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:14 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:15.666503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:15.667338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:15.675929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:15.676174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:15.677277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:15.677815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:15.736231 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] HTTP exception thrown: Instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b could not be found. Apr 08 12:19:15.736920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Returning 404 to user: Instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:19:15.737849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a774ce37-411c-4fdd-b32b-4c091cbce565 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 404 len: 111 microversion: 2.1 time: 0.076328 Apr 08 12:19:15.738509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 369/709] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:15 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:19:15.749856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-532e8b60-ced6-423c-ab7e-4d3a629d2b8f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '.version_select at 0x7f22587ead08>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:15.796965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6b408283-e62e-4659-9ca6-e21756ba244d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:15.798011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6b408283-e62e-4659-9ca6-e21756ba244d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:15.805724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-532e8b60-ced6-423c-ab7e-4d3a629d2b8f tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635349907" status: 202 len: 0 microversion: 2.1 time: 0.059512 Apr 08 12:19:15.806893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 341/710] 10.222.0.43 () {58 vars in 1208 bytes} [Thu Apr 8 12:19:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635349907 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:15.808285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b408283-e62e-4659-9ca6-e21756ba244d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:15.808946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b408283-e62e-4659-9ca6-e21756ba244d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:15.809794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b408283-e62e-4659-9ca6-e21756ba244d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:15.810547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b408283-e62e-4659-9ca6-e21756ba244d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:15.913916 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6b408283-e62e-4659-9ca6-e21756ba244d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.120937 Apr 08 12:19:15.917935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 370/711] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:15 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:16.926331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-15167cd6-e6a5-462c-9ed6-09c044ce04f9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:16.927651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-15167cd6-e6a5-462c-9ed6-09c044ce04f9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:16.936403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15167cd6-e6a5-462c-9ed6-09c044ce04f9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:16.936911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15167cd6-e6a5-462c-9ed6-09c044ce04f9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:16.937874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15167cd6-e6a5-462c-9ed6-09c044ce04f9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:16.938414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15167cd6-e6a5-462c-9ed6-09c044ce04f9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:17.031306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-15167cd6-e6a5-462c-9ed6-09c044ce04f9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.109584 Apr 08 12:19:17.032004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 342/712] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:16 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:17.171668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-65b9e9cc-fa2c-44d7-bf9d-e6c0f32afc45 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'create', calling method: .version_select at 0x7f22587ad268>, body: {"keypair": {"name": "tempest-keypair-990375888"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:17.195575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-65b9e9cc-fa2c-44d7-bf9d-e6c0f32afc45 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:19:17.199695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-65b9e9cc-fa2c-44d7-bf9d-e6c0f32afc45 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for user d3bca9a02e384de89ed455e272f4ea76 and project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:19:17.432535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-65b9e9cc-fa2c-44d7-bf9d-e6c0f32afc45 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:19:17.436544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-65b9e9cc-fa2c-44d7-bf9d-e6c0f32afc45 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for user d3bca9a02e384de89ed455e272f4ea76 and project 78e331e206224c7aad5f2f90f7059f26. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:19:17.450396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-65b9e9cc-fa2c-44d7-bf9d-e6c0f32afc45 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.283375 Apr 08 12:19:17.451053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 371/713] 10.222.0.43 () {60 vars in 1148 bytes} [Thu Apr 8 12:19:17 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:18.043666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-22c825eb-2f3e-4a1b-ad2f-ad691d409042 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:18.044806 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-22c825eb-2f3e-4a1b-ad2f-ad691d409042 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:18.054543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22c825eb-2f3e-4a1b-ad2f-ad691d409042 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:18.055060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22c825eb-2f3e-4a1b-ad2f-ad691d409042 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:18.055904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22c825eb-2f3e-4a1b-ad2f-ad691d409042 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:18.056397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22c825eb-2f3e-4a1b-ad2f-ad691d409042 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:18.156102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-22c825eb-2f3e-4a1b-ad2f-ad691d409042 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.116712 Apr 08 12:19:18.159585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 343/714] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:18 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:19.168794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b9efac9-e9b8-4e79-9ce0-72d5d37ab9dd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:19.169892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8b9efac9-e9b8-4e79-9ce0-72d5d37ab9dd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:19.179340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b9efac9-e9b8-4e79-9ce0-72d5d37ab9dd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:19.179861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b9efac9-e9b8-4e79-9ce0-72d5d37ab9dd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:19.180721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b9efac9-e9b8-4e79-9ce0-72d5d37ab9dd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:19.181222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b9efac9-e9b8-4e79-9ce0-72d5d37ab9dd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:19.281062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b9efac9-e9b8-4e79-9ce0-72d5d37ab9dd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.116801 Apr 08 12:19:19.283716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 372/715] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:19 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:20.110864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1202141235", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b1fc7d4-88cb-4a68-a3ed-5bf40dc45f61"}], "security_groups": [{"name": "tempest-securitygroup--72183919"}], "key_name": "tempest-keypair-990375888", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:20.255478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] validate_networks() for [('6b1fc7d4-88cb-4a68-a3ed-5bf40dc45f61', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:19:20.293865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4ae8c787-7c12-46d9-aa6e-03d6c1ae9804 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:20.295031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4ae8c787-7c12-46d9-aa6e-03d6c1ae9804 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:20.304577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae8c787-7c12-46d9-aa6e-03d6c1ae9804 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:20.305093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae8c787-7c12-46d9-aa6e-03d6c1ae9804 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:20.305932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae8c787-7c12-46d9-aa6e-03d6c1ae9804 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:20.306453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae8c787-7c12-46d9-aa6e-03d6c1ae9804 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:20.402575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4ae8c787-7c12-46d9-aa6e-03d6c1ae9804 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.112953 Apr 08 12:19:20.403269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 373/716] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:20 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:20.881329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:19:20.881808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:19:20.882377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:19:20.882843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:19:20.883306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:19:20.892537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:20.893043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:20.893921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:20.894445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:20.915120 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for project 78e331e206224c7aad5f2f90f7059f26. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:19:20.919582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Getting quotas for user d3bca9a02e384de89ed455e272f4ea76 and project 78e331e206224c7aad5f2f90f7059f26. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:19:20.931242 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:19:20.933960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:19:21.088148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0276cf64-0d92-4091-9386-32d51f282896 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.982107 Apr 08 12:19:21.088827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 344/717] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:19:20 2021] POST /compute/v2.1/servers => generated 400 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:19:21.100432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-74eabea2-6e88-4cad-94c8-00bc9d73482b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:21.101217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-74eabea2-6e88-4cad-94c8-00bc9d73482b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:21.379485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-74eabea2-6e88-4cad-94c8-00bc9d73482b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:21.388835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-74eabea2-6e88-4cad-94c8-00bc9d73482b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1237 microversion: 2.1 time: 0.293080 Apr 08 12:19:21.389482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 374/718] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:21 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1237 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:21.414363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-863d45d4-332a-4260-928a-60e9e3932fce tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:21.415511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-863d45d4-332a-4260-928a-60e9e3932fce tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:21.424231 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863d45d4-332a-4260-928a-60e9e3932fce tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:21.424745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863d45d4-332a-4260-928a-60e9e3932fce tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:21.425576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863d45d4-332a-4260-928a-60e9e3932fce tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:21.426070 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863d45d4-332a-4260-928a-60e9e3932fce tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:21.522253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-863d45d4-332a-4260-928a-60e9e3932fce tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.112476 Apr 08 12:19:21.525776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 345/719] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:21 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:22.407051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:22.407723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:22.417079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:22.417591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:22.418462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:22.418960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:22.534220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d61194e8-80f2-439a-ba24-0fd5b0ea1356 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:22.535395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d61194e8-80f2-439a-ba24-0fd5b0ea1356 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:22.546255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d61194e8-80f2-439a-ba24-0fd5b0ea1356 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:22.546831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d61194e8-80f2-439a-ba24-0fd5b0ea1356 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:22.547703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d61194e8-80f2-439a-ba24-0fd5b0ea1356 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:22.548207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d61194e8-80f2-439a-ba24-0fd5b0ea1356 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:22.558347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:22.569615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d63b3aeb-aec1-414c-b716-847be59e07ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1289 microversion: 2.1 time: 0.166502 Apr 08 12:19:22.570255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 375/720] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:22 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1289 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:22.654787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d61194e8-80f2-439a-ba24-0fd5b0ea1356 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.124819 Apr 08 12:19:22.658860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 346/721] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:22 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:23.588941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:23.589742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:23.599597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:23.599597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:23.600424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:23.600833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:23.672630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59e2a4a2-5a55-4557-a53f-e4df5199d227 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:23.673970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59e2a4a2-5a55-4557-a53f-e4df5199d227 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:23.683887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59e2a4a2-5a55-4557-a53f-e4df5199d227 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:23.684543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59e2a4a2-5a55-4557-a53f-e4df5199d227 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:23.685632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59e2a4a2-5a55-4557-a53f-e4df5199d227 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:23.686135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59e2a4a2-5a55-4557-a53f-e4df5199d227 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:23.798154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59e2a4a2-5a55-4557-a53f-e4df5199d227 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 14 microversion: 2.20 time: 0.134394 Apr 08 12:19:23.799281 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 347/722] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:23 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:23.840991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:23.851833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9568599b-5ee7-4f75-b217-a294db2f73d5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.267531 Apr 08 12:19:23.852447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 376/723] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:23 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:24.812597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9a4eeee5-fc0e-4759-a8d2-b02a6a57fbfb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:24.813404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9a4eeee5-fc0e-4759-a8d2-b02a6a57fbfb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:24.822237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a4eeee5-fc0e-4759-a8d2-b02a6a57fbfb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:24.822808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a4eeee5-fc0e-4759-a8d2-b02a6a57fbfb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:24.823664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a4eeee5-fc0e-4759-a8d2-b02a6a57fbfb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:24.824170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a4eeee5-fc0e-4759-a8d2-b02a6a57fbfb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:24.870125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:24.871189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:24.882814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:24.883418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:24.884160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:24.884632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:24.940239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9a4eeee5-fc0e-4759-a8d2-b02a6a57fbfb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 8992 microversion: 2.20 time: 0.132525 Apr 08 12:19:24.941099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 348/724] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:24 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 8992 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:25.080071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:25.090029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5440b1ff-c404-4c25-b5e9-77473089e7be tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.224140 Apr 08 12:19:25.090687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 377/725] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:24 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:25.145814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-201cdf1c-bcc7-4bff-98e8-517eb8cfad11 req-d30a34aa-a3a1-4093-81a3-18e735cf9ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8047aad6-b96b-45e1-ada9-3c6063b5fb08", "tag": "ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:25.147527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:25.147527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:25.158294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-201cdf1c-bcc7-4bff-98e8-517eb8cfad11 req-d30a34aa-a3a1-4093-81a3-18e735cf9ac2 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:25.158828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-201cdf1c-bcc7-4bff-98e8-517eb8cfad11 req-d30a34aa-a3a1-4093-81a3-18e735cf9ac2 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:25.177417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-201cdf1c-bcc7-4bff-98e8-517eb8cfad11 req-d30a34aa-a3a1-4093-81a3-18e735cf9ac2 service nova] Creating event network-changed:ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f for instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 on hv-cinder-78477 Apr 08 12:19:25.184526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-201cdf1c-bcc7-4bff-98e8-517eb8cfad11 req-d30a34aa-a3a1-4093-81a3-18e735cf9ac2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044612 Apr 08 12:19:25.187057 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 349/726] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:25.952833 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-525043e5-f99e-4a5e-b05d-0a9129ec9508 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:25.953959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-525043e5-f99e-4a5e-b05d-0a9129ec9508 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:25.962608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525043e5-f99e-4a5e-b05d-0a9129ec9508 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:25.963121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525043e5-f99e-4a5e-b05d-0a9129ec9508 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:25.964003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525043e5-f99e-4a5e-b05d-0a9129ec9508 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:25.964450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-525043e5-f99e-4a5e-b05d-0a9129ec9508 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:26.061866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-525043e5-f99e-4a5e-b05d-0a9129ec9508 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 16123 microversion: 2.20 time: 0.112981 Apr 08 12:19:26.062618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 378/727] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:25 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 16123 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:26.109967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:26.110812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:26.119411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:26.119926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:26.120772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:26.121268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:26.610414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:26.619918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9a71e3ca-b7b3-4415-b2da-064a6a62bca4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.514466 Apr 08 12:19:26.620548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 350/728] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:26 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:27.075009 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-90c928f6-1ea6-4655-a0df-41025c4f52e7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:27.076157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-90c928f6-1ea6-4655-a0df-41025c4f52e7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:27.085053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90c928f6-1ea6-4655-a0df-41025c4f52e7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:27.085570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90c928f6-1ea6-4655-a0df-41025c4f52e7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:27.086438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90c928f6-1ea6-4655-a0df-41025c4f52e7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:27.086936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-90c928f6-1ea6-4655-a0df-41025c4f52e7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:27.192062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-90c928f6-1ea6-4655-a0df-41025c4f52e7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 18608 microversion: 2.20 time: 0.121381 Apr 08 12:19:27.192707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 379/729] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:27 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 18608 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:27.475702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2101557051", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-366820502", "security_groups": [{"name": "tempest-secgroup-smoke-312513591"}], "networks": [{"uuid": "b6d23616-b27e-41fd-b140-34c013f91138"}], "block_device_mapping_v2": [{"uuid": "08932f70-5797-4241-af25-cb4fc6e739ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:27.640605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:27.641320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:27.650808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:27.661527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:27.661527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:27.661527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:27.677719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] validate_networks() for [('b6d23616-b27e-41fd-b140-34c013f91138', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:19:27.852474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:27.861559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dcc232bb-e0bf-494b-8bcf-e9a4b1bf3003 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.225581 Apr 08 12:19:27.862192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 380/730] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:27 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:28.204345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c0be33fb-4a14-4ca6-9364-eff2fb7a70dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:28.205317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c0be33fb-4a14-4ca6-9364-eff2fb7a70dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:28.213418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0be33fb-4a14-4ca6-9364-eff2fb7a70dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:28.213931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0be33fb-4a14-4ca6-9364-eff2fb7a70dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:28.214840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0be33fb-4a14-4ca6-9364-eff2fb7a70dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:28.215336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c0be33fb-4a14-4ca6-9364-eff2fb7a70dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:28.282628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:19:28.283116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:19:28.283660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:19:28.284216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:19:28.284749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:19:28.295298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:28.295828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:28.296681 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:28.297173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:28.314103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c0be33fb-4a14-4ca6-9364-eff2fb7a70dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 20675 microversion: 2.20 time: 0.113761 Apr 08 12:19:28.314955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 381/731] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:28 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 20675 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:28.320765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Getting quotas for project f89c54d8444949e0a136701bbc6c6577. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:19:28.325083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Getting quotas for user 0c7678801cc44322b9ac950e68ee5cc0 and project f89c54d8444949e0a136701bbc6c6577. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:19:28.433977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:19:28.436546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08932f70-5797-4241-af25-cb4fc6e739ae',volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:19:28.726175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-929c46e9-7323-4c1e-95f6-84a294d9320f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.255237 Apr 08 12:19:28.726924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 351/732] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:19:27 2021] POST /compute/v2.1/servers => generated 405 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:19:28.738313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-864c5f85-f77b-4a48-a416-b585f719989a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:28.739803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-864c5f85-f77b-4a48-a416-b585f719989a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:28.819912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-864c5f85-f77b-4a48-a416-b585f719989a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:28.828145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-864c5f85-f77b-4a48-a416-b585f719989a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1088 microversion: 2.1 time: 0.094372 Apr 08 12:19:28.828766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 382/733] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:28 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:28.935027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:28.935701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:28.944869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:28.945388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:28.946276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:28.946821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:29.149901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:29.158743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d8957791-88cd-48b6-9ae9-04051fb67fef tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.282917 Apr 08 12:19:29.168728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 352/734] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:28 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:29.325706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-57ba9d5a-3721-487d-9dbe-adca79258765 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:29.326884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-57ba9d5a-3721-487d-9dbe-adca79258765 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:29.336731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57ba9d5a-3721-487d-9dbe-adca79258765 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:29.337340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57ba9d5a-3721-487d-9dbe-adca79258765 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:29.338182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57ba9d5a-3721-487d-9dbe-adca79258765 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:29.338747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-57ba9d5a-3721-487d-9dbe-adca79258765 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:29.487121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-57ba9d5a-3721-487d-9dbe-adca79258765 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 22981 microversion: 2.20 time: 0.165395 Apr 08 12:19:29.487745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 383/735] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:29 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 22981 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:29.847199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:29.847960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:29.856025 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:29.856545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:29.857402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:29.857906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:29.982350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:29.992468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-37e46c82-4a24-43cb-8d71-35d8a1aafdda tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1130 microversion: 2.1 time: 0.149485 Apr 08 12:19:29.993104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 353/736] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:29 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1130 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:30.178551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:30.179264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:30.188247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:30.188762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:30.189627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:30.190129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:30.392258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:30.401369 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9469a2bb-e748-4113-b97a-d02492ac7bad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.228119 Apr 08 12:19:30.402205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 384/737] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:30 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:30.498843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f599ae46-d1dc-40fb-865f-11b378da97a7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:30.500533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f599ae46-d1dc-40fb-865f-11b378da97a7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:30.509610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f599ae46-d1dc-40fb-865f-11b378da97a7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:30.510121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f599ae46-d1dc-40fb-865f-11b378da97a7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:30.511039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f599ae46-d1dc-40fb-865f-11b378da97a7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:30.511531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f599ae46-d1dc-40fb-865f-11b378da97a7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:30.619188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f599ae46-d1dc-40fb-865f-11b378da97a7 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 24312 microversion: 2.20 time: 0.124219 Apr 08 12:19:30.620118 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 354/738] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:30 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 24312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:31.017267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:31.017945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:31.031901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:31.033338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:31.034846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:31.036520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:31.171719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:31.181720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8caf3c70-173b-4a4c-8e6c-03d9d4963c07 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1204 microversion: 2.1 time: 0.168455 Apr 08 12:19:31.182497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 385/739] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:31 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1204 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:31.420438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:31.421204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:31.430510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:31.431027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:31.431887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:31.432363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:31.631815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-213b85b8-54b0-41f5-ab1e-812f30327128 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:31.633190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-213b85b8-54b0-41f5-ab1e-812f30327128 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:31.642646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-213b85b8-54b0-41f5-ab1e-812f30327128 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:31.643290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-213b85b8-54b0-41f5-ab1e-812f30327128 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:31.644250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-213b85b8-54b0-41f5-ab1e-812f30327128 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:31.644906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-213b85b8-54b0-41f5-ab1e-812f30327128 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:31.756353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-213b85b8-54b0-41f5-ab1e-812f30327128 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 25786 microversion: 2.20 time: 0.128312 Apr 08 12:19:31.760360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 386/740] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:31 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 25786 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:31.769709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:31.780304 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-23b7c708-f345-403a-b0c5-735329519023 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.364393 Apr 08 12:19:31.781124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 355/741] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:31 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:32.202512 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:32.203259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:32.213320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:32.213832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:32.214783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:32.215285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:32.453321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:32.463094 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ce6c429a-4e22-4a71-ad78-c959c1ad650c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.265322 Apr 08 12:19:32.463744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 387/742] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:32 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:32.768764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8c66b7cb-f81e-4a94-9fce-fe1905e3d9df tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:32.770065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8c66b7cb-f81e-4a94-9fce-fe1905e3d9df tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:32.778624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8c66b7cb-f81e-4a94-9fce-fe1905e3d9df tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:32.779208 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8c66b7cb-f81e-4a94-9fce-fe1905e3d9df tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:32.780619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8c66b7cb-f81e-4a94-9fce-fe1905e3d9df tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:32.781214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8c66b7cb-f81e-4a94-9fce-fe1905e3d9df tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:32.799115 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:32.799804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:32.820528 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:32.821477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:32.822596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:32.823308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:32.899315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8c66b7cb-f81e-4a94-9fce-fe1905e3d9df tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 27080 microversion: 2.20 time: 0.134582 Apr 08 12:19:32.900519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 356/743] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:32 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 27080 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:19:32.974949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-ee7920f1-5474-4514-ba5f-80820960fb7c req-1e930d1a-750d-4836-809d-30f2ee00c511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8047aad6-b96b-45e1-ada9-3c6063b5fb08", "name": "network-vif-plugged", "status": "completed", "tag": "ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:32.977073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:32.977073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:32.991456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ee7920f1-5474-4514-ba5f-80820960fb7c req-1e930d1a-750d-4836-809d-30f2ee00c511 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:32.992287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ee7920f1-5474-4514-ba5f-80820960fb7c req-1e930d1a-750d-4836-809d-30f2ee00c511 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:33.013482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-ee7920f1-5474-4514-ba5f-80820960fb7c req-1e930d1a-750d-4836-809d-30f2ee00c511 service nova] Creating event network-vif-plugged:ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f for instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 on hv-cinder-78477 Apr 08 12:19:33.020803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-ee7920f1-5474-4514-ba5f-80820960fb7c req-1e930d1a-750d-4836-809d-30f2ee00c511 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052927 Apr 08 12:19:33.022747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 357/744] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:33.033639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:33.043650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-661cfab8-b69a-4ed8-9863-4b62ebcaf918 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.248992 Apr 08 12:19:33.044620 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 388/745] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:32 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:33.482575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:33.483666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:33.492475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:33.492970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:33.493868 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:33.494390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:33.911861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-32ed22d4-505a-42d3-96da-47ac50eed7fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:33.912942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-32ed22d4-505a-42d3-96da-47ac50eed7fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:33.921262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32ed22d4-505a-42d3-96da-47ac50eed7fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:33.921782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32ed22d4-505a-42d3-96da-47ac50eed7fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:33.922696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32ed22d4-505a-42d3-96da-47ac50eed7fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:33.923199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-32ed22d4-505a-42d3-96da-47ac50eed7fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:33.940145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:33.950031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4dc55215-f9f2-47fd-a638-43acf86bb6ba tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.472350 Apr 08 12:19:33.950978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 358/746] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:33 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:34.008453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-fa4727c7-ce32-47c9-8c1c-1573de051cff req-c1231600-6679-4c01-b8d9-afa9102e0786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6deb0bf-27c9-49e9-b44b-7871e994fb76", "tag": "7aa28d27-c593-4d1f-bd76-5d3dccb52b3c"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:34.010140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:34.010140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:34.019528 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-fa4727c7-ce32-47c9-8c1c-1573de051cff req-c1231600-6679-4c01-b8d9-afa9102e0786 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:34.020079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-fa4727c7-ce32-47c9-8c1c-1573de051cff req-c1231600-6679-4c01-b8d9-afa9102e0786 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:34.028076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-32ed22d4-505a-42d3-96da-47ac50eed7fc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 27832 microversion: 2.20 time: 0.114542 Apr 08 12:19:34.028076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 389/747] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:33 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 27832 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:19:34.038171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-fa4727c7-ce32-47c9-8c1c-1573de051cff req-c1231600-6679-4c01-b8d9-afa9102e0786 service nova] Creating event network-changed:7aa28d27-c593-4d1f-bd76-5d3dccb52b3c for instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 on hv-cinder-78477 Apr 08 12:19:34.043414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-fa4727c7-ce32-47c9-8c1c-1573de051cff req-c1231600-6679-4c01-b8d9-afa9102e0786 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039398 Apr 08 12:19:34.044083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 359/748] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:19:34.063955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:34.065002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:34.076522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:34.077049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:34.077920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:34.078481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:34.289695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:34.298915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59931dd7-6e6f-459c-b629-06571388970e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1361 microversion: 2.1 time: 0.240493 Apr 08 12:19:34.299547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 390/749] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:34 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:34.968959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:34.969743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:34.978027 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:34.978603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:34.979451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:34.979946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:35.037575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9f6bda23-d566-4fdd-8eb7-484de8b490c5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:35.038881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9f6bda23-d566-4fdd-8eb7-484de8b490c5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:35.046779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f6bda23-d566-4fdd-8eb7-484de8b490c5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:35.047376 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f6bda23-d566-4fdd-8eb7-484de8b490c5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:35.048339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f6bda23-d566-4fdd-8eb7-484de8b490c5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:35.048903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9f6bda23-d566-4fdd-8eb7-484de8b490c5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:35.148018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9f6bda23-d566-4fdd-8eb7-484de8b490c5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 28199 microversion: 2.20 time: 0.114254 Apr 08 12:19:35.148886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 391/750] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:35 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 28199 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:19:35.260784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:35.269712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-283ca742-4cc8-4a69-b39d-e887c0aeac7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.305337 Apr 08 12:19:35.270383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 360/751] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:34 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:35.318002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:35.318832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:35.327424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:35.327939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:35.328774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:35.329269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:35.524899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:35.533735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6006d6ed-7ab7-4d42-a406-93c85d2fbe28 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1547 microversion: 2.1 time: 0.220270 Apr 08 12:19:35.534381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 392/752] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:35 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1547 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:35.551576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-205b157b-f63b-4215-8593-eb475872238e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:35.552118 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-205b157b-f63b-4215-8593-eb475872238e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:35.559923 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205b157b-f63b-4215-8593-eb475872238e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:35.560430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205b157b-f63b-4215-8593-eb475872238e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:35.561263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205b157b-f63b-4215-8593-eb475872238e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:35.561756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-205b157b-f63b-4215-8593-eb475872238e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:35.716619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-205b157b-f63b-4215-8593-eb475872238e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169014 Apr 08 12:19:35.717272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 361/753] 10.222.0.43 () {58 vars in 1265 bytes} [Thu Apr 8 12:19:35 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:36.161127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-09ea1a2b-e0d4-46de-b2b2-00e1e9cc2029 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:36.162179 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-09ea1a2b-e0d4-46de-b2b2-00e1e9cc2029 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:36.170619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-09ea1a2b-e0d4-46de-b2b2-00e1e9cc2029 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:36.171131 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-09ea1a2b-e0d4-46de-b2b2-00e1e9cc2029 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:36.171999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-09ea1a2b-e0d4-46de-b2b2-00e1e9cc2029 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:36.172493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-09ea1a2b-e0d4-46de-b2b2-00e1e9cc2029 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:36.279676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-09ea1a2b-e0d4-46de-b2b2-00e1e9cc2029 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 28199 microversion: 2.20 time: 0.122863 Apr 08 12:19:36.283946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 393/754] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:36 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 28199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:36.288731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:36.289362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:36.297927 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:36.298488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:36.299365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:36.299870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:36.648129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:36.657050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f52effe8-849d-4837-9ffd-5a654d29c983 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.373510 Apr 08 12:19:36.657721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 362/755] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:36 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:37.294198 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-02b0e32f-aa76-4642-8c33-bcfd91de831e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:37.295500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-02b0e32f-aa76-4642-8c33-bcfd91de831e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:37.304334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02b0e32f-aa76-4642-8c33-bcfd91de831e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:37.304854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02b0e32f-aa76-4642-8c33-bcfd91de831e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:37.305704 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02b0e32f-aa76-4642-8c33-bcfd91de831e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:37.306203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02b0e32f-aa76-4642-8c33-bcfd91de831e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:37.402587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-02b0e32f-aa76-4642-8c33-bcfd91de831e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 28490 microversion: 2.20 time: 0.112763 Apr 08 12:19:37.404271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 394/756] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:37 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 28490 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:37.623469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c2c3bdf4-05cb-41cf-a38c-1f14fef9008a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:37.624852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c2c3bdf4-05cb-41cf-a38c-1f14fef9008a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:37.626861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-9c2ef217-d83c-405c-a0ec-fecc20381cc1 req-d0d5e7f3-1af1-4361-a5f6-669020cae3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8047aad6-b96b-45e1-ada9-3c6063b5fb08", "tag": "ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:37.628573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:37.628573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:37.634004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c2c3bdf4-05cb-41cf-a38c-1f14fef9008a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:37.634566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c2c3bdf4-05cb-41cf-a38c-1f14fef9008a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:37.635408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c2c3bdf4-05cb-41cf-a38c-1f14fef9008a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:37.635901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c2c3bdf4-05cb-41cf-a38c-1f14fef9008a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:37.639746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9c2ef217-d83c-405c-a0ec-fecc20381cc1 req-d0d5e7f3-1af1-4361-a5f6-669020cae3b4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:37.640261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9c2ef217-d83c-405c-a0ec-fecc20381cc1 req-d0d5e7f3-1af1-4361-a5f6-669020cae3b4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:37.658414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-9c2ef217-d83c-405c-a0ec-fecc20381cc1 req-d0d5e7f3-1af1-4361-a5f6-669020cae3b4 service nova] Creating event network-changed:ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f for instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 on hv-cinder-78477 Apr 08 12:19:37.663646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-9c2ef217-d83c-405c-a0ec-fecc20381cc1 req-d0d5e7f3-1af1-4361-a5f6-669020cae3b4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041525 Apr 08 12:19:37.664583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 395/757] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:37.676801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:37.677575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:37.686380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:37.686905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:37.687796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:37.688307 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:37.737413 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c2c3bdf4-05cb-41cf-a38c-1f14fef9008a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.117659 Apr 08 12:19:37.739598 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 363/758] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:37 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:19:37.895602 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:37.905477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1fdd9ec3-f968-4d40-8d8a-1ba5e2abdfcc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.233630 Apr 08 12:19:37.906284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 396/759] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:37 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:38.416759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7b38a13e-1392-41d5-9673-d9033923e3cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:38.417786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7b38a13e-1392-41d5-9673-d9033923e3cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:38.441746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b38a13e-1392-41d5-9673-d9033923e3cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:38.446583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b38a13e-1392-41d5-9673-d9033923e3cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:38.446583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b38a13e-1392-41d5-9673-d9033923e3cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:38.446583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7b38a13e-1392-41d5-9673-d9033923e3cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:38.548274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7b38a13e-1392-41d5-9673-d9033923e3cd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 28658 microversion: 2.20 time: 0.135820 Apr 08 12:19:38.549933 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 364/760] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:38 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 28658 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:38.749925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f0667d67-8180-4565-8431-eba0ea3b366b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:38.750942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f0667d67-8180-4565-8431-eba0ea3b366b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:38.759523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0667d67-8180-4565-8431-eba0ea3b366b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:38.760035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0667d67-8180-4565-8431-eba0ea3b366b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:38.760883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0667d67-8180-4565-8431-eba0ea3b366b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:38.761378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f0667d67-8180-4565-8431-eba0ea3b366b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:38.875473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f0667d67-8180-4565-8431-eba0ea3b366b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.129458 Apr 08 12:19:38.876237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 397/761] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:38 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:19:38.924252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:38.925183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:38.934272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:38.934897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:38.935777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:38.936280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:39.138399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:39.148880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-891c1336-58dd-439e-aaee-d65de521bb49 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.229074 Apr 08 12:19:39.149514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 365/762] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:38 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:39.561594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6a146f74-66b4-4391-ad84-eed3fb72af06 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:39.562762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6a146f74-66b4-4391-ad84-eed3fb72af06 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:39.572340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6a146f74-66b4-4391-ad84-eed3fb72af06 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:39.572801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6a146f74-66b4-4391-ad84-eed3fb72af06 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:39.573642 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6a146f74-66b4-4391-ad84-eed3fb72af06 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:39.574147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6a146f74-66b4-4391-ad84-eed3fb72af06 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:39.673678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6a146f74-66b4-4391-ad84-eed3fb72af06 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 28658 microversion: 2.20 time: 0.116498 Apr 08 12:19:39.674397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 398/763] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:39 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 28658 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:39.886989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-56e5c90e-8556-4e85-be2a-5003ab3ca63e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:39.887976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-56e5c90e-8556-4e85-be2a-5003ab3ca63e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:39.896020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-56e5c90e-8556-4e85-be2a-5003ab3ca63e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:39.896506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-56e5c90e-8556-4e85-be2a-5003ab3ca63e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:39.897345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-56e5c90e-8556-4e85-be2a-5003ab3ca63e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:39.897840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-56e5c90e-8556-4e85-be2a-5003ab3ca63e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:39.995407 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-56e5c90e-8556-4e85-be2a-5003ab3ca63e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.112491 Apr 08 12:19:39.996060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 366/764] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:39 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:19:40.168343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:40.169114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:40.177827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:40.178361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:40.179216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:40.179717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:40.374877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:40.384256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f017875d-43a9-4c91-80b7-a6071e9cb68e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.220488 Apr 08 12:19:40.394244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 399/765] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:40 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:40.687596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-97a3a367-bc5a-49b8-ba29-23ff965437cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:40.688678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-97a3a367-bc5a-49b8-ba29-23ff965437cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:40.698040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97a3a367-bc5a-49b8-ba29-23ff965437cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:40.698615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97a3a367-bc5a-49b8-ba29-23ff965437cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:40.699461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97a3a367-bc5a-49b8-ba29-23ff965437cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:40.699961 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97a3a367-bc5a-49b8-ba29-23ff965437cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:40.797175 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-97a3a367-bc5a-49b8-ba29-23ff965437cf tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 28658 microversion: 2.20 time: 0.113991 Apr 08 12:19:40.797855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 367/766] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:40 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 28658 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:41.008039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-02625464-c5a4-44d6-a874-d0f52f1f5a2e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:41.009000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-02625464-c5a4-44d6-a874-d0f52f1f5a2e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:41.016773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02625464-c5a4-44d6-a874-d0f52f1f5a2e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:41.017277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02625464-c5a4-44d6-a874-d0f52f1f5a2e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:41.018105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02625464-c5a4-44d6-a874-d0f52f1f5a2e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:41.018617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-02625464-c5a4-44d6-a874-d0f52f1f5a2e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:41.121494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-02625464-c5a4-44d6-a874-d0f52f1f5a2e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.118213 Apr 08 12:19:41.122196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 400/767] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:41 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:19:41.402935 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:41.403840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:41.415217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:41.415723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:41.416570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:41.417061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:41.609117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:41.618067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1311dcf6-b18d-4c45-b25c-fb23ce9e9230 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.219959 Apr 08 12:19:41.618721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 368/768] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:41 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:41.810856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f3c7a8d1-d764-49cd-8bca-eaf87883bc19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:41.811999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f3c7a8d1-d764-49cd-8bca-eaf87883bc19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:41.821142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f3c7a8d1-d764-49cd-8bca-eaf87883bc19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:41.821651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f3c7a8d1-d764-49cd-8bca-eaf87883bc19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:41.822525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f3c7a8d1-d764-49cd-8bca-eaf87883bc19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:41.823024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f3c7a8d1-d764-49cd-8bca-eaf87883bc19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:41.920916 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f3c7a8d1-d764-49cd-8bca-eaf87883bc19 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 29910 microversion: 2.20 time: 0.114494 Apr 08 12:19:41.921586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 401/769] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:41 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 29910 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:42.134004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-43bed89d-739f-4220-8d12-4062e44b2a86 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:42.135016 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-43bed89d-739f-4220-8d12-4062e44b2a86 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:42.143070 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bed89d-739f-4220-8d12-4062e44b2a86 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:42.143579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bed89d-739f-4220-8d12-4062e44b2a86 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:42.144408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bed89d-739f-4220-8d12-4062e44b2a86 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:42.144897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-43bed89d-739f-4220-8d12-4062e44b2a86 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:42.243709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-43bed89d-739f-4220-8d12-4062e44b2a86 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.114179 Apr 08 12:19:42.244375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 369/770] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:42 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:19:42.637144 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:42.637922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:42.646620 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:42.647134 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:42.647976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:42.648472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:42.841813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:42.851311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-48b7e757-463a-4c58-ac76-61a3e52d8a42 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.218686 Apr 08 12:19:42.851940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 402/771] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:42 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:42.934893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1f3927ce-0138-4107-be20-a59ff0fb673c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:42.936189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1f3927ce-0138-4107-be20-a59ff0fb673c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:42.945240 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3927ce-0138-4107-be20-a59ff0fb673c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:42.945845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3927ce-0138-4107-be20-a59ff0fb673c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:42.946803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3927ce-0138-4107-be20-a59ff0fb673c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:42.947474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1f3927ce-0138-4107-be20-a59ff0fb673c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:43.062938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1f3927ce-0138-4107-be20-a59ff0fb673c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 31963 microversion: 2.20 time: 0.132476 Apr 08 12:19:43.066114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 370/772] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:42 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 31963 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:43.256051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b0580548-f2b9-447a-84d2-daa516c58b12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:43.257029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b0580548-f2b9-447a-84d2-daa516c58b12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:43.265401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0580548-f2b9-447a-84d2-daa516c58b12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:43.265929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0580548-f2b9-447a-84d2-daa516c58b12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:43.266853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0580548-f2b9-447a-84d2-daa516c58b12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:43.267351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b0580548-f2b9-447a-84d2-daa516c58b12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:43.371392 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b0580548-f2b9-447a-84d2-daa516c58b12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.119488 Apr 08 12:19:43.375184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 403/773] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:43 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:19:43.870518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:43.871285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:43.880721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:43.881231 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:43.882063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:43.882586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:44.076692 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4a311dcf-35c6-4cc1-af9c-3031b3da6754 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:44.077837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4a311dcf-35c6-4cc1-af9c-3031b3da6754 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:44.080046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:44.086705 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a311dcf-35c6-4cc1-af9c-3031b3da6754 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:44.087211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a311dcf-35c6-4cc1-af9c-3031b3da6754 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:44.088110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a311dcf-35c6-4cc1-af9c-3031b3da6754 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:44.088601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a311dcf-35c6-4cc1-af9c-3031b3da6754 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:44.090066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1ee9d998-63c8-41bc-b7df-3660b7d4db2c tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.224089 Apr 08 12:19:44.090740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 371/774] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:43 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:44.191261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4a311dcf-35c6-4cc1-af9c-3031b3da6754 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 33371 microversion: 2.20 time: 0.118861 Apr 08 12:19:44.192161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 404/775] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:44 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 33371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:44.384540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-42c8ba43-d78a-4948-a551-bf5a6d53af0e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:44.385729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-42c8ba43-d78a-4948-a551-bf5a6d53af0e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:44.393758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42c8ba43-d78a-4948-a551-bf5a6d53af0e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:44.394276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42c8ba43-d78a-4948-a551-bf5a6d53af0e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:44.395160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42c8ba43-d78a-4948-a551-bf5a6d53af0e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:44.396298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42c8ba43-d78a-4948-a551-bf5a6d53af0e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:44.504335 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-42c8ba43-d78a-4948-a551-bf5a6d53af0e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.124640 Apr 08 12:19:44.505148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 372/776] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:44 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:19:44.959653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-e4c59cbb-87a6-4321-b189-b24ad80abfd0 req-42c486fc-abcf-43fa-b409-6be1602da0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6deb0bf-27c9-49e9-b44b-7871e994fb76", "name": "network-vif-plugged", "status": "completed", "tag": "7aa28d27-c593-4d1f-bd76-5d3dccb52b3c"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:44.961212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:44.961212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:44.970736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e4c59cbb-87a6-4321-b189-b24ad80abfd0 req-42c486fc-abcf-43fa-b409-6be1602da0eb service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:44.971239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-e4c59cbb-87a6-4321-b189-b24ad80abfd0 req-42c486fc-abcf-43fa-b409-6be1602da0eb service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:44.988613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-e4c59cbb-87a6-4321-b189-b24ad80abfd0 req-42c486fc-abcf-43fa-b409-6be1602da0eb service nova] Creating event network-vif-plugged:7aa28d27-c593-4d1f-bd76-5d3dccb52b3c for instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 on hv-cinder-78477 Apr 08 12:19:44.993693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-e4c59cbb-87a6-4321-b189-b24ad80abfd0 req-42c486fc-abcf-43fa-b409-6be1602da0eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039462 Apr 08 12:19:44.994505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 405/777] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:45.109705 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:45.110621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:45.119473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:45.119983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:45.120818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:45.121320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:45.204979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5adc78f1-8de1-47ef-89e8-972ff2d97a62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:45.206439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5adc78f1-8de1-47ef-89e8-972ff2d97a62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:45.216493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5adc78f1-8de1-47ef-89e8-972ff2d97a62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:45.217217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5adc78f1-8de1-47ef-89e8-972ff2d97a62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:45.218186 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5adc78f1-8de1-47ef-89e8-972ff2d97a62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:45.218812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5adc78f1-8de1-47ef-89e8-972ff2d97a62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:45.335628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5adc78f1-8de1-47ef-89e8-972ff2d97a62 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 34440 microversion: 2.20 time: 0.135389 Apr 08 12:19:45.336488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 406/778] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:45 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 34440 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:45.516665 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2508bfd4-024f-42b9-978b-9119873d33c0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:45.517794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2508bfd4-024f-42b9-978b-9119873d33c0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:45.527438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2508bfd4-024f-42b9-978b-9119873d33c0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:45.527924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2508bfd4-024f-42b9-978b-9119873d33c0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:45.528762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2508bfd4-024f-42b9-978b-9119873d33c0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:45.529255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2508bfd4-024f-42b9-978b-9119873d33c0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:45.542431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:45.551359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-53c48951-9043-420b-bd64-ab4afac34c7e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1259 microversion: 2.1 time: 0.446116 Apr 08 12:19:45.552043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 373/779] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:45 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1259 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:19:45.632842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2508bfd4-024f-42b9-978b-9119873d33c0 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.120421 Apr 08 12:19:45.633451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 407/780] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:45 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 12:19:46.350081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dd2b081a-c1dc-43a1-914c-f734e06067e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:46.350651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dd2b081a-c1dc-43a1-914c-f734e06067e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:46.359074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd2b081a-c1dc-43a1-914c-f734e06067e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.359585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd2b081a-c1dc-43a1-914c-f734e06067e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:46.360424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd2b081a-c1dc-43a1-914c-f734e06067e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.360919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd2b081a-c1dc-43a1-914c-f734e06067e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:46.467646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dd2b081a-c1dc-43a1-914c-f734e06067e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 35305 microversion: 2.20 time: 0.122867 Apr 08 12:19:46.468336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 374/781] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:46 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 35305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:19:46.570102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:46.570977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:46.579744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.580250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:46.581091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.581625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:46.645164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-64f7413d-95de-46e1-adb0-f86b02673112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:46.646771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-64f7413d-95de-46e1-adb0-f86b02673112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:46.655387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-64f7413d-95de-46e1-adb0-f86b02673112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.655910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-64f7413d-95de-46e1-adb0-f86b02673112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:46.656764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-64f7413d-95de-46e1-adb0-f86b02673112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.657266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-64f7413d-95de-46e1-adb0-f86b02673112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:46.758763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-64f7413d-95de-46e1-adb0-f86b02673112 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14 microversion: 2.1 time: 0.117952 Apr 08 12:19:46.762127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 375/782] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:46 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 12:19:46.780254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:46.789974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6b7d72d9-c896-4f90-8028-2b5462435484 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1444 microversion: 2.1 time: 0.224398 Apr 08 12:19:46.790629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 408/783] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:46 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:46.807623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:46.808401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:46.816854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.817367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:46.818209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:46.818756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:47.010312 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:47.019138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1b33f278-5164-4973-b7be-ae45574f764b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1444 microversion: 2.1 time: 0.215993 Apr 08 12:19:47.019758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 376/784] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:19:46 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1444 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:47.480555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fdc343ed-7316-4e3a-92f9-768517c25bbd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:47.481623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fdc343ed-7316-4e3a-92f9-768517c25bbd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:47.490861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc343ed-7316-4e3a-92f9-768517c25bbd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:47.491274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc343ed-7316-4e3a-92f9-768517c25bbd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:47.492258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc343ed-7316-4e3a-92f9-768517c25bbd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:47.492755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc343ed-7316-4e3a-92f9-768517c25bbd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:47.595586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fdc343ed-7316-4e3a-92f9-768517c25bbd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 36806 microversion: 2.20 time: 0.118965 Apr 08 12:19:47.600578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 409/785] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:47 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 36806 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:47.769564 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c9e4de0c-4314-41fd-b3b5-14b599bf207d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:47.770622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c9e4de0c-4314-41fd-b3b5-14b599bf207d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:47.779593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9e4de0c-4314-41fd-b3b5-14b599bf207d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:47.780104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9e4de0c-4314-41fd-b3b5-14b599bf207d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:47.780940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9e4de0c-4314-41fd-b3b5-14b599bf207d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:47.781429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9e4de0c-4314-41fd-b3b5-14b599bf207d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:47.882487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c9e4de0c-4314-41fd-b3b5-14b599bf207d tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 2993 microversion: 2.1 time: 0.116672 Apr 08 12:19:47.883373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 377/786] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:47 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 2993 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:19:48.609727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c25b869a-899a-4167-8baa-23aa701f175b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:48.610893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c25b869a-899a-4167-8baa-23aa701f175b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:48.620115 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c25b869a-899a-4167-8baa-23aa701f175b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:48.620627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c25b869a-899a-4167-8baa-23aa701f175b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:48.621475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c25b869a-899a-4167-8baa-23aa701f175b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:48.621972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c25b869a-899a-4167-8baa-23aa701f175b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:48.733625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c25b869a-899a-4167-8baa-23aa701f175b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 38196 microversion: 2.20 time: 0.128396 Apr 08 12:19:48.734636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 410/787] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:48 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 38196 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:48.894371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-620b04ad-7a27-49f6-bec8-ace59af5e1de tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:48.895458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-620b04ad-7a27-49f6-bec8-ace59af5e1de tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:48.905047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-620b04ad-7a27-49f6-bec8-ace59af5e1de tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:48.905566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-620b04ad-7a27-49f6-bec8-ace59af5e1de tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:48.906594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-620b04ad-7a27-49f6-bec8-ace59af5e1de tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:48.907119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-620b04ad-7a27-49f6-bec8-ace59af5e1de tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:49.014745 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-620b04ad-7a27-49f6-bec8-ace59af5e1de tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 14250 microversion: 2.1 time: 0.124697 Apr 08 12:19:49.018584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 378/788] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:48 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 14250 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:19:49.865714 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-348ceead-9859-4d68-bf9b-af25b5feae51 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:49.867019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-348ceead-9859-4d68-bf9b-af25b5feae51 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:49.875520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-348ceead-9859-4d68-bf9b-af25b5feae51 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:49.876042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-348ceead-9859-4d68-bf9b-af25b5feae51 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:49.876897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-348ceead-9859-4d68-bf9b-af25b5feae51 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:49.877396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-348ceead-9859-4d68-bf9b-af25b5feae51 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:49.979355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-348ceead-9859-4d68-bf9b-af25b5feae51 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 38196 microversion: 2.20 time: 0.236226 Apr 08 12:19:49.980046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 411/789] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:49 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 38196 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:50.026690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9d8cd84e-d0ec-4c8e-8065-ad47ebc29a5e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:50.027775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9d8cd84e-d0ec-4c8e-8065-ad47ebc29a5e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:50.036038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8cd84e-d0ec-4c8e-8065-ad47ebc29a5e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:50.037040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8cd84e-d0ec-4c8e-8065-ad47ebc29a5e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:50.038072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8cd84e-d0ec-4c8e-8065-ad47ebc29a5e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:50.038655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d8cd84e-d0ec-4c8e-8065-ad47ebc29a5e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:50.144199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9d8cd84e-d0ec-4c8e-8065-ad47ebc29a5e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 18305 microversion: 2.1 time: 0.121634 Apr 08 12:19:50.145879 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 379/790] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:50 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 18305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:50.311152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-814af178-f9ae-48a1-9732-e86611263580 req-17025c55-0b1c-4bab-be79-7cc439a68da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6deb0bf-27c9-49e9-b44b-7871e994fb76", "tag": "7aa28d27-c593-4d1f-bd76-5d3dccb52b3c"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:50.312826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:19:50.312826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:19:50.322113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-814af178-f9ae-48a1-9732-e86611263580 req-17025c55-0b1c-4bab-be79-7cc439a68da3 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:50.322667 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-814af178-f9ae-48a1-9732-e86611263580 req-17025c55-0b1c-4bab-be79-7cc439a68da3 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:50.340454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-814af178-f9ae-48a1-9732-e86611263580 req-17025c55-0b1c-4bab-be79-7cc439a68da3 service nova] Creating event network-changed:7aa28d27-c593-4d1f-bd76-5d3dccb52b3c for instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 on hv-cinder-78477 Apr 08 12:19:50.345623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-814af178-f9ae-48a1-9732-e86611263580 req-17025c55-0b1c-4bab-be79-7cc439a68da3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097042 Apr 08 12:19:50.346476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 412/791] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:19:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:19:50.992974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-231894d6-b69e-4aff-9cb3-406fcd57358d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:50.994181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-231894d6-b69e-4aff-9cb3-406fcd57358d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:51.003514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-231894d6-b69e-4aff-9cb3-406fcd57358d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:51.004045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-231894d6-b69e-4aff-9cb3-406fcd57358d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:51.005618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-231894d6-b69e-4aff-9cb3-406fcd57358d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:51.006128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-231894d6-b69e-4aff-9cb3-406fcd57358d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:51.105879 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-231894d6-b69e-4aff-9cb3-406fcd57358d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 38196 microversion: 2.20 time: 0.117553 Apr 08 12:19:51.107327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 380/792] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:50 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 38196 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:51.157401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ef1ccb1a-a643-4410-8e63-82b9b813952a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:51.158736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ef1ccb1a-a643-4410-8e63-82b9b813952a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:51.167257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef1ccb1a-a643-4410-8e63-82b9b813952a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:51.167867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef1ccb1a-a643-4410-8e63-82b9b813952a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:51.168856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef1ccb1a-a643-4410-8e63-82b9b813952a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:51.169309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ef1ccb1a-a643-4410-8e63-82b9b813952a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:51.273036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ef1ccb1a-a643-4410-8e63-82b9b813952a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 19342 microversion: 2.1 time: 0.120072 Apr 08 12:19:51.277365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 413/793] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:51 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 19342 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:52.119674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-18030fb1-9fb1-4f59-ac33-59697d1c33bd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:52.120805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-18030fb1-9fb1-4f59-ac33-59697d1c33bd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:52.129675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18030fb1-9fb1-4f59-ac33-59697d1c33bd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:52.130245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18030fb1-9fb1-4f59-ac33-59697d1c33bd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:52.131150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18030fb1-9fb1-4f59-ac33-59697d1c33bd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:52.131659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-18030fb1-9fb1-4f59-ac33-59697d1c33bd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:52.232519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-18030fb1-9fb1-4f59-ac33-59697d1c33bd tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 38196 microversion: 2.20 time: 0.117371 Apr 08 12:19:52.233161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 381/794] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:52 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 38196 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:52.287633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aab64616-c624-41cf-8b1a-4869347f3645 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:52.288763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aab64616-c624-41cf-8b1a-4869347f3645 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:52.297362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab64616-c624-41cf-8b1a-4869347f3645 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:52.297874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab64616-c624-41cf-8b1a-4869347f3645 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:52.298758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab64616-c624-41cf-8b1a-4869347f3645 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:52.299253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab64616-c624-41cf-8b1a-4869347f3645 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:52.393568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aab64616-c624-41cf-8b1a-4869347f3645 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 22119 microversion: 2.1 time: 0.110377 Apr 08 12:19:52.398349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 414/795] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:52 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 22119 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:53.246479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d45070e0-3228-4813-9e0b-273e0e9c88ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:53.247626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d45070e0-3228-4813-9e0b-273e0e9c88ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:53.256478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d45070e0-3228-4813-9e0b-273e0e9c88ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:53.256990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d45070e0-3228-4813-9e0b-273e0e9c88ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:53.257832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d45070e0-3228-4813-9e0b-273e0e9c88ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:53.258365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d45070e0-3228-4813-9e0b-273e0e9c88ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:53.355177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d45070e0-3228-4813-9e0b-273e0e9c88ca tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 200 len: 38333 microversion: 2.20 time: 0.113138 Apr 08 12:19:53.356105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 382/796] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:53 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 38333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:19:53.367664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1d757dda-828f-4dbd-b1d0-a462fb983d33 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:53.368316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1d757dda-828f-4dbd-b1d0-a462fb983d33 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:53.377147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1d757dda-828f-4dbd-b1d0-a462fb983d33 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:53.377660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1d757dda-828f-4dbd-b1d0-a462fb983d33 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:53.378538 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1d757dda-828f-4dbd-b1d0-a462fb983d33 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:53.379036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1d757dda-828f-4dbd-b1d0-a462fb983d33 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:53.407587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8749f2d0-aea0-4856-a15a-2aa0dcbfa5ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:53.408809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8749f2d0-aea0-4856-a15a-2aa0dcbfa5ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:53.418831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8749f2d0-aea0-4856-a15a-2aa0dcbfa5ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:53.419352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8749f2d0-aea0-4856-a15a-2aa0dcbfa5ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:53.420248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8749f2d0-aea0-4856-a15a-2aa0dcbfa5ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:53.420750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8749f2d0-aea0-4856-a15a-2aa0dcbfa5ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:53.444236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1d757dda-828f-4dbd-b1d0-a462fb983d33 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/ips" status: 200 len: 151 microversion: 2.20 time: 0.081771 Apr 08 12:19:53.444878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 415/797] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Apr 8 12:19:53 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/ips => generated 151 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:53.521223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8749f2d0-aea0-4856-a15a-2aa0dcbfa5ae tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 23804 microversion: 2.1 time: 0.117657 Apr 08 12:19:53.522107 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 383/798] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:53 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 23804 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:19:54.533575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a6395dd0-9a8d-4cec-84bd-e7a23d3bc1ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:54.534635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a6395dd0-9a8d-4cec-84bd-e7a23d3bc1ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:54.543600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6395dd0-9a8d-4cec-84bd-e7a23d3bc1ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:54.544113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6395dd0-9a8d-4cec-84bd-e7a23d3bc1ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:54.544952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6395dd0-9a8d-4cec-84bd-e7a23d3bc1ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:54.545446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a6395dd0-9a8d-4cec-84bd-e7a23d3bc1ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:54.645484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a6395dd0-9a8d-4cec-84bd-e7a23d3bc1ed tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 25543 microversion: 2.1 time: 0.115820 Apr 08 12:19:54.646702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 416/799] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:54 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 25543 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:55.658617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1e911e54-cbb2-44c9-b10b-95f49a88d71a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:55.659751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1e911e54-cbb2-44c9-b10b-95f49a88d71a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:55.668193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e911e54-cbb2-44c9-b10b-95f49a88d71a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:55.668700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e911e54-cbb2-44c9-b10b-95f49a88d71a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:55.669534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e911e54-cbb2-44c9-b10b-95f49a88d71a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:55.670026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e911e54-cbb2-44c9-b10b-95f49a88d71a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:55.769446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1e911e54-cbb2-44c9-b10b-95f49a88d71a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 27033 microversion: 2.1 time: 0.115018 Apr 08 12:19:55.770040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 384/800] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:55 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 27033 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:55.814412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:55.815101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:55.824740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:55.825255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:55.826100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:55.826624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:55.886463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lazy-loading 'flavor' on Instance uuid c3dd2b74-811a-48ae-b536-083c33d13d45 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:19:56.401391 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-99187ccc-3729-42ce-a3b6-7c26b5648452 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 202 len: 0 microversion: 2.20 time: 0.591371 Apr 08 12:19:56.402256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 417/801] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:19:55 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:19:56.411896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:56.412644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:56.421194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:56.421707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:56.422639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:56.423137 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:56.622440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:56.632785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:56.634489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:56.635771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b8cd37fd-250f-4a5d-a63e-0003483d3d14 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.228646 Apr 08 12:19:56.636346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 385/802] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:56 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:56.782811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aded95af-3aee-45d4-a4d6-72ab95a07803 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:56.783940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aded95af-3aee-45d4-a4d6-72ab95a07803 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:56.793443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aded95af-3aee-45d4-a4d6-72ab95a07803 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:56.793950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aded95af-3aee-45d4-a4d6-72ab95a07803 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:56.794809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aded95af-3aee-45d4-a4d6-72ab95a07803 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:56.795303 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aded95af-3aee-45d4-a4d6-72ab95a07803 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:56.896357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aded95af-3aee-45d4-a4d6-72ab95a07803 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 27548 microversion: 2.1 time: 0.117704 Apr 08 12:19:56.896995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 418/803] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:56 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 27548 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:19:57.655744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:57.656506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:57.665055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:57.665571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:57.666468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:57.666964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:57.857614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:57.867533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:57.869212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:57.870466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e54c9249-7fdc-4dcf-8edb-d69c8c0bda56 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.218829 Apr 08 12:19:57.871087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 386/804] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:57 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:57.909375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-203526bb-09be-43be-930b-767229fc9d70 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:57.910559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-203526bb-09be-43be-930b-767229fc9d70 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:57.920011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-203526bb-09be-43be-930b-767229fc9d70 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:57.920545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-203526bb-09be-43be-930b-767229fc9d70 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:57.921378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-203526bb-09be-43be-930b-767229fc9d70 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:57.921875 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-203526bb-09be-43be-930b-767229fc9d70 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:58.035852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-203526bb-09be-43be-930b-767229fc9d70 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 28017 microversion: 2.1 time: 0.130876 Apr 08 12:19:58.036545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 419/805] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:57 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 28017 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:19:58.891532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:19:58.892204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:58.900633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:58.901151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:58.901994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:58.902522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:59.049510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b52266b4-df90-4937-8f65-3838a2e28017 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:19:59.050698 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b52266b4-df90-4937-8f65-3838a2e28017 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:19:59.059500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b52266b4-df90-4937-8f65-3838a2e28017 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:59.060023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b52266b4-df90-4937-8f65-3838a2e28017 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:59.060882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b52266b4-df90-4937-8f65-3838a2e28017 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:19:59.061384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b52266b4-df90-4937-8f65-3838a2e28017 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:19:59.105343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:59.115656 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:59.117370 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:19:59.118731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3aaab0e8-79aa-4a33-873c-8ad678901199 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.231315 Apr 08 12:19:59.119362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 387/806] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:19:58 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:19:59.306495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b52266b4-df90-4937-8f65-3838a2e28017 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 28201 microversion: 2.1 time: 0.261377 Apr 08 12:19:59.307390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 420/807] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:19:59 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 28201 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:20:00.138721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:00.139430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:00.147722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:00.148235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:00.149069 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:00.149562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:00.319282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3f978c34-a875-4aa7-ab2a-b303349cb84b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:00.320678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3f978c34-a875-4aa7-ab2a-b303349cb84b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:00.329415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f978c34-a875-4aa7-ab2a-b303349cb84b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:00.329930 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f978c34-a875-4aa7-ab2a-b303349cb84b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:00.330840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f978c34-a875-4aa7-ab2a-b303349cb84b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:00.331333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f978c34-a875-4aa7-ab2a-b303349cb84b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:00.343366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:00.353377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:00.355088 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:00.356329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-51d51a85-77c7-4a97-b6c9-e0ddefe8d79b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.221797 Apr 08 12:20:00.356942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 388/808] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:00 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:00.434987 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3f978c34-a875-4aa7-ab2a-b303349cb84b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 28492 microversion: 2.1 time: 0.120632 Apr 08 12:20:00.435694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 421/809] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:00 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 28492 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:20:01.382316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:01.383020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:01.390936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:01.391455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:01.392314 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:01.392811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:01.448078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4ae9b502-6de0-4d3d-a602-367e7ab9e09b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:01.449210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4ae9b502-6de0-4d3d-a602-367e7ab9e09b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:01.457835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae9b502-6de0-4d3d-a602-367e7ab9e09b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:01.458381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae9b502-6de0-4d3d-a602-367e7ab9e09b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:01.459992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae9b502-6de0-4d3d-a602-367e7ab9e09b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:01.460498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4ae9b502-6de0-4d3d-a602-367e7ab9e09b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:01.573571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4ae9b502-6de0-4d3d-a602-367e7ab9e09b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 28660 microversion: 2.1 time: 0.130503 Apr 08 12:20:01.574998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 422/810] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:01 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 28660 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:20:01.594403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:01.602528 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:01.604205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:01.605513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ebb4ac7a-b9ea-4d5f-9a33-2b117df37dc8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.227876 Apr 08 12:20:01.606174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 389/811] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:01 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:02.587271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e62dfd7d-7d66-4c98-bb38-18f81e8766a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:02.588428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e62dfd7d-7d66-4c98-bb38-18f81e8766a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:02.597014 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e62dfd7d-7d66-4c98-bb38-18f81e8766a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:02.597527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e62dfd7d-7d66-4c98-bb38-18f81e8766a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:02.598418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e62dfd7d-7d66-4c98-bb38-18f81e8766a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:02.598916 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e62dfd7d-7d66-4c98-bb38-18f81e8766a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:02.625591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:02.626258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:02.634791 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:02.635305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:02.636138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:02.636629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:02.699966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e62dfd7d-7d66-4c98-bb38-18f81e8766a5 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 28660 microversion: 2.1 time: 0.117064 Apr 08 12:20:02.704140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 423/812] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:02 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 28660 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:02.834955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:02.844341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:02.846148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:02.847436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ed5083d3-4baf-4f39-a417-830155a29637 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.226245 Apr 08 12:20:02.848050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 390/813] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:02 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:03.713746 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-037a9b57-693b-4d36-ae8a-9e3e8266d830 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:03.714843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-037a9b57-693b-4d36-ae8a-9e3e8266d830 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:03.723329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-037a9b57-693b-4d36-ae8a-9e3e8266d830 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:03.723837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-037a9b57-693b-4d36-ae8a-9e3e8266d830 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:03.724694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-037a9b57-693b-4d36-ae8a-9e3e8266d830 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:03.725181 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-037a9b57-693b-4d36-ae8a-9e3e8266d830 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:03.829113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-037a9b57-693b-4d36-ae8a-9e3e8266d830 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 28660 microversion: 2.1 time: 0.120478 Apr 08 12:20:03.829780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 424/814] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:03 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 28660 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:03.868225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:03.868901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:03.877248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:03.877763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:03.878640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:03.879145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:04.077266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:04.086797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:04.088462 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:04.089671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-15cb5d6f-cad5-44fa-8429-c4f88f975ef1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.226037 Apr 08 12:20:04.090282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 391/815] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:03 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:04.842331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0e78f02e-f7fe-48fb-b6d1-aaee1d60063b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:04.843516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0e78f02e-f7fe-48fb-b6d1-aaee1d60063b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:04.852741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e78f02e-f7fe-48fb-b6d1-aaee1d60063b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:04.853244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e78f02e-f7fe-48fb-b6d1-aaee1d60063b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:04.854126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e78f02e-f7fe-48fb-b6d1-aaee1d60063b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:04.854638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e78f02e-f7fe-48fb-b6d1-aaee1d60063b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:04.954901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0e78f02e-f7fe-48fb-b6d1-aaee1d60063b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 28660 microversion: 2.1 time: 0.116965 Apr 08 12:20:04.955557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 425/816] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:04 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 28660 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:05.109299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:05.109907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:05.118455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:05.118974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:05.119820 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:05.120319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:05.314890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:05.324680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:05.326404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:05.327645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9eb4a74f-0827-408d-9d8c-0d3a741fece9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.222621 Apr 08 12:20:05.328254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 392/817] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:05 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:05.968689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dcde1b98-364f-4146-b927-6675236502fc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:05.969858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dcde1b98-364f-4146-b927-6675236502fc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:05.978441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcde1b98-364f-4146-b927-6675236502fc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:05.978950 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcde1b98-364f-4146-b927-6675236502fc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:05.979791 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcde1b98-364f-4146-b927-6675236502fc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:05.980286 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcde1b98-364f-4146-b927-6675236502fc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:06.081885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dcde1b98-364f-4146-b927-6675236502fc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 30072 microversion: 2.1 time: 0.117549 Apr 08 12:20:06.082650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 426/818] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:05 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 30072 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:06.347060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:06.347854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:06.355713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:06.356233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:06.357074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:06.357624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:06.577352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:06.586786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:06.588481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:06.589700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9b8efc31-43ae-4521-a35d-931e63c44e9b tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.246778 Apr 08 12:20:06.590333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 393/819] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:06 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:07.096095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d348ce8e-8307-4745-92dc-a491bb51ac02 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:07.097279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d348ce8e-8307-4745-92dc-a491bb51ac02 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:07.106928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d348ce8e-8307-4745-92dc-a491bb51ac02 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:07.107486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d348ce8e-8307-4745-92dc-a491bb51ac02 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:07.108326 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d348ce8e-8307-4745-92dc-a491bb51ac02 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:07.108823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d348ce8e-8307-4745-92dc-a491bb51ac02 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:07.212798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d348ce8e-8307-4745-92dc-a491bb51ac02 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 32042 microversion: 2.1 time: 0.120487 Apr 08 12:20:07.213477 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 427/820] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:07 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 32042 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:07.608540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:07.609210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:07.617260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:07.617776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:07.619173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:07.619789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:07.813327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:07.823557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:07.825245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:07.826502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6b9ec6bb-37b8-42c6-ae80-4a63b39fb577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1740 microversion: 2.20 time: 0.222151 Apr 08 12:20:07.827120 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 394/821] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:07 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:08.226041 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-632342bc-bb34-4b3d-95ff-781bcd7255cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:08.227208 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-632342bc-bb34-4b3d-95ff-781bcd7255cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:08.236463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-632342bc-bb34-4b3d-95ff-781bcd7255cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:08.236970 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-632342bc-bb34-4b3d-95ff-781bcd7255cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:08.237802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-632342bc-bb34-4b3d-95ff-781bcd7255cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:08.238291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-632342bc-bb34-4b3d-95ff-781bcd7255cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:08.343203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-632342bc-bb34-4b3d-95ff-781bcd7255cb tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 33010 microversion: 2.1 time: 0.121367 Apr 08 12:20:08.344064 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 428/822] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:08 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 33010 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:08.846529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:08.847228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:08.856345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:08.856804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:08.857743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:08.858114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:09.072382 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:09.082411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:09.084100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:09.085544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b6c35b39-2029-492b-b9ec-0270f2d69577 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.242951 Apr 08 12:20:09.086203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 395/823] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:08 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:09.356778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4a65f1d8-5e15-4a15-aa31-14753d4779b9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:09.357939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4a65f1d8-5e15-4a15-aa31-14753d4779b9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:09.367206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a65f1d8-5e15-4a15-aa31-14753d4779b9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:09.367721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a65f1d8-5e15-4a15-aa31-14753d4779b9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:09.368690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a65f1d8-5e15-4a15-aa31-14753d4779b9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:09.369365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a65f1d8-5e15-4a15-aa31-14753d4779b9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:09.484912 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4a65f1d8-5e15-4a15-aa31-14753d4779b9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 33766 microversion: 2.1 time: 0.132797 Apr 08 12:20:09.486363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 429/824] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:09 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 33766 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:10.111707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:10.112370 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:10.121196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:10.121910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:10.122964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:10.123461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:10.329530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:10.339754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:10.341709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:10.342986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3093c557-7e93-4f73-a337-b4ef2ea253fb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.235533 Apr 08 12:20:10.355128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 396/825] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:10 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:10.500785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b43a9d0-fe4d-4ebe-95de-e6da2ec0b28e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:10.502257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8b43a9d0-fe4d-4ebe-95de-e6da2ec0b28e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:10.511814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b43a9d0-fe4d-4ebe-95de-e6da2ec0b28e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:10.512612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b43a9d0-fe4d-4ebe-95de-e6da2ec0b28e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:10.513807 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b43a9d0-fe4d-4ebe-95de-e6da2ec0b28e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:10.514982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8b43a9d0-fe4d-4ebe-95de-e6da2ec0b28e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:10.625697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b43a9d0-fe4d-4ebe-95de-e6da2ec0b28e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 34824 microversion: 2.1 time: 0.129858 Apr 08 12:20:10.626350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 430/826] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:10 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 34824 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:20:11.160600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-f9cdfe8a-e15e-45df-98fc-10b3214af391 req-a8450914-2c54-4caf-bc11-88bf598850d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dd2b74-811a-48ae-b536-083c33d13d45", "name": "network-vif-plugged", "status": "completed", "tag": "fb2e14a6-43f6-49b1-b7b3-9f9fb1687767"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:11.162779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:20:11.162779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:20:11.172576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-f9cdfe8a-e15e-45df-98fc-10b3214af391 req-a8450914-2c54-4caf-bc11-88bf598850d3 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:11.175444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-f9cdfe8a-e15e-45df-98fc-10b3214af391 req-a8450914-2c54-4caf-bc11-88bf598850d3 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:11.197553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-f9cdfe8a-e15e-45df-98fc-10b3214af391 req-a8450914-2c54-4caf-bc11-88bf598850d3 service nova] Creating event network-vif-plugged:fb2e14a6-43f6-49b1-b7b3-9f9fb1687767 for instance c3dd2b74-811a-48ae-b536-083c33d13d45 on hv-cinder-78477 Apr 08 12:20:11.203419 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-f9cdfe8a-e15e-45df-98fc-10b3214af391 req-a8450914-2c54-4caf-bc11-88bf598850d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109704 Apr 08 12:20:11.204420 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 397/827] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:20:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:11.364562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:11.365801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:11.375432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:11.375954 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:11.376896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:11.377400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:11.606819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:11.614049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:11.615744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:11.616979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-19904e0d-754b-4889-9d76-a8a48bb726a8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.258260 Apr 08 12:20:11.617623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 431/828] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:11 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:11.640562 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-85bbe5f5-0f1d-4672-9f69-dcbb87f25cbc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:11.641765 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-85bbe5f5-0f1d-4672-9f69-dcbb87f25cbc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:11.650618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-85bbe5f5-0f1d-4672-9f69-dcbb87f25cbc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:11.651142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-85bbe5f5-0f1d-4672-9f69-dcbb87f25cbc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:11.652039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-85bbe5f5-0f1d-4672-9f69-dcbb87f25cbc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:11.652544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-85bbe5f5-0f1d-4672-9f69-dcbb87f25cbc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:11.763037 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-85bbe5f5-0f1d-4672-9f69-dcbb87f25cbc tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 35823 microversion: 2.1 time: 0.126704 Apr 08 12:20:11.764093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 398/829] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:11 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 35823 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:12.638809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:12.639469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:12.647877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:12.648390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:12.649226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:12.649720 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:12.777402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2a18c5f1-a20f-4447-a0a4-390f0b90e788 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:12.778513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2a18c5f1-a20f-4447-a0a4-390f0b90e788 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:12.787772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a18c5f1-a20f-4447-a0a4-390f0b90e788 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:12.788290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a18c5f1-a20f-4447-a0a4-390f0b90e788 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:12.789309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a18c5f1-a20f-4447-a0a4-390f0b90e788 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:12.789696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2a18c5f1-a20f-4447-a0a4-390f0b90e788 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:12.905605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2a18c5f1-a20f-4447-a0a4-390f0b90e788 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 37176 microversion: 2.1 time: 0.133318 Apr 08 12:20:12.906352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 399/830] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:12 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 37176 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 12:20:13.096359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:13.107532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:13.109192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:13.110671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8373d7dd-4041-4e62-8e1d-3320a6d7c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.476404 Apr 08 12:20:13.112090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 432/831] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:12 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:13.919520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1e6d3346-8554-4d0e-b1dc-2873eeb348cd tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:13.920600 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1e6d3346-8554-4d0e-b1dc-2873eeb348cd tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:13.929353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e6d3346-8554-4d0e-b1dc-2873eeb348cd tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:13.929872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e6d3346-8554-4d0e-b1dc-2873eeb348cd tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:13.930755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e6d3346-8554-4d0e-b1dc-2873eeb348cd tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:13.931279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e6d3346-8554-4d0e-b1dc-2873eeb348cd tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:14.038808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1e6d3346-8554-4d0e-b1dc-2873eeb348cd tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 38193 microversion: 2.1 time: 0.124251 Apr 08 12:20:14.039755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 400/832] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:13 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 38193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:14.131663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:14.132327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:14.142784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:14.143293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:14.144141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:14.144777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:14.354050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:14.364393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:14.366072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:14.367456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dd4f2799-d9b8-40d9-8d43-01d3e4b37491 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.239990 Apr 08 12:20:14.368227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 433/833] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:14 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:15.052368 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3105eee0-0c05-4b93-8a1d-1f1588e53306 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:15.053583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3105eee0-0c05-4b93-8a1d-1f1588e53306 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:15.063493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3105eee0-0c05-4b93-8a1d-1f1588e53306 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:15.064019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3105eee0-0c05-4b93-8a1d-1f1588e53306 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:15.064885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3105eee0-0c05-4b93-8a1d-1f1588e53306 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:15.065397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3105eee0-0c05-4b93-8a1d-1f1588e53306 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:15.171267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3105eee0-0c05-4b93-8a1d-1f1588e53306 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 38193 microversion: 2.1 time: 0.123444 Apr 08 12:20:15.172218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 401/834] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:15 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 38193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:15.388497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:15.389351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:15.398633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:15.399157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:15.400585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:15.401163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:15.610964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:15.621049 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:15.622761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:15.623991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6eff0bc9-c1e2-4a93-90b7-6db6857568f4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.239940 Apr 08 12:20:15.624612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 434/835] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:15 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:16.185429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-15f84ad3-678a-436c-837b-01147d99fdb4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:16.187309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-15f84ad3-678a-436c-837b-01147d99fdb4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:16.197223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15f84ad3-678a-436c-837b-01147d99fdb4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:16.198078 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15f84ad3-678a-436c-837b-01147d99fdb4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:16.199777 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15f84ad3-678a-436c-837b-01147d99fdb4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:16.200372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-15f84ad3-678a-436c-837b-01147d99fdb4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:16.307095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-15f84ad3-678a-436c-837b-01147d99fdb4 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 38193 microversion: 2.1 time: 0.126297 Apr 08 12:20:16.308996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 402/836] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:16 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 38193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:16.644449 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:16.645308 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:16.653826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:16.654359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:16.655257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:16.655790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:16.859700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:16.873124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:16.875288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:16.876529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-132db007-15aa-4bc0-9406-c37331d159d2 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.236492 Apr 08 12:20:16.877307 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 435/837] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:16 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:17.321421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d22f7275-a874-49a8-a00b-e288715bbdf9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:17.322741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d22f7275-a874-49a8-a00b-e288715bbdf9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:17.331884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d22f7275-a874-49a8-a00b-e288715bbdf9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:17.332679 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d22f7275-a874-49a8-a00b-e288715bbdf9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:17.333754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d22f7275-a874-49a8-a00b-e288715bbdf9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:17.334399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d22f7275-a874-49a8-a00b-e288715bbdf9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:17.454650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d22f7275-a874-49a8-a00b-e288715bbdf9 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action" status: 200 len: 38324 microversion: 2.1 time: 0.137509 Apr 08 12:20:17.455706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 403/838] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:20:17 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/action => generated 38324 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:17.467763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1bf283c5-707c-402f-814f-68e17c59595b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:17.468566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1bf283c5-707c-402f-814f-68e17c59595b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:17.476768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1bf283c5-707c-402f-814f-68e17c59595b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:17.477576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1bf283c5-707c-402f-814f-68e17c59595b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:17.478905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1bf283c5-707c-402f-814f-68e17c59595b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:17.480337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1bf283c5-707c-402f-814f-68e17c59595b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:17.544651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1bf283c5-707c-402f-814f-68e17c59595b tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/ips" status: 200 len: 145 microversion: 2.1 time: 0.081755 Apr 08 12:20:17.545301 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 436/839] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Apr 8 12:20:17 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/ips => generated 145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:17.897205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:17.904077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:17.909398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:17.910159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:17.911159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:17.911740 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:18.194172 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:18.205920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:18.208371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:18.209808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bfccef25-738d-4c09-a357-e3aeae0e3900 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.317116 Apr 08 12:20:18.210503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 404/840] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:17 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:19.212227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c844d995-7ee4-45fc-a59a-f09ff248e587 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c387bfb6-0972-4024-81a1-f392299cbccc"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:19.213506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c844d995-7ee4-45fc-a59a-f09ff248e587 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:19.222061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c844d995-7ee4-45fc-a59a-f09ff248e587 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:19.226543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c844d995-7ee4-45fc-a59a-f09ff248e587 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:19.226543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c844d995-7ee4-45fc-a59a-f09ff248e587 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:19.226543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c844d995-7ee4-45fc-a59a-f09ff248e587 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:19.232044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:19.232712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:19.241215 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:19.241722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:19.242586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:19.243077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:19.498089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:19.510471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:19.512729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:19.514171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f8590df6-cbda-4baf-bad9-d52fa673c31a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.286334 Apr 08 12:20:19.529102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 405/841] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:19 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:19.867403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c844d995-7ee4-45fc-a59a-f09ff248e587 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659060 Apr 08 12:20:19.868488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 437/842] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:20:19 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:20.533608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:20.534219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:20.542731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:20.543708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:20.544769 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:20.545278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:20.750938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:20.760394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:20.762519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:20.763736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-42683d06-f256-4831-bcb7-b8a42250c962 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1735 microversion: 2.20 time: 0.234350 Apr 08 12:20:20.764396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 406/843] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:20 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:21.784128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:21.784884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:21.793118 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:21.793624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:21.794476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:21.794969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:21.990895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:22.000965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:22.002645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:22.003851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0d13e784-412a-48ea-9231-e8278e300f04 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1717 microversion: 2.20 time: 0.224839 Apr 08 12:20:22.004461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 438/844] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:21 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1717 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:23.024781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:23.025456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:23.034574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:23.035094 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:23.035971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:23.036471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:23.230158 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:23.239586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:23.241259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:23.242503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5539fde2-778a-4c09-8724-39eb2a13e01f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1717 microversion: 2.20 time: 0.221866 Apr 08 12:20:23.243112 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 407/845] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:23 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1717 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:24.262819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:24.263486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:24.271801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:24.272311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:24.273154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:24.273700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:24.470383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:24.480040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:24.481706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:24.482941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5fcf9a51-94ce-40d8-8535-5cbf3f30ecb6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1660 microversion: 2.20 time: 0.224494 Apr 08 12:20:24.483547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 439/846] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:24 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1660 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:24.502247 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-16fde438-46e0-4440-866a-3911ccb2d3b8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "143d1a3d-cda4-47e8-961b-368991b57da2"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:24.503492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-16fde438-46e0-4440-866a-3911ccb2d3b8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:24.512001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16fde438-46e0-4440-866a-3911ccb2d3b8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:24.512520 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16fde438-46e0-4440-866a-3911ccb2d3b8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:24.513366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16fde438-46e0-4440-866a-3911ccb2d3b8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:24.513870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-16fde438-46e0-4440-866a-3911ccb2d3b8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:25.100313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d7f7d807-da48-41e6-bb57-dd03012e90dd req-39091130-964c-4319-a169-be0b0fd67762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dd2b74-811a-48ae-b536-083c33d13d45", "name": "network-vif-unplugged", "status": "completed", "tag": "fb2e14a6-43f6-49b1-b7b3-9f9fb1687767"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:25.102141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:20:25.102141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:20:25.111251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d7f7d807-da48-41e6-bb57-dd03012e90dd req-39091130-964c-4319-a169-be0b0fd67762 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:25.111760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d7f7d807-da48-41e6-bb57-dd03012e90dd req-39091130-964c-4319-a169-be0b0fd67762 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:25.129799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.compute.server_external_events [req-d7f7d807-da48-41e6-bb57-dd03012e90dd req-39091130-964c-4319-a169-be0b0fd67762 service nova] Unable to find a host for instance c3dd2b74-811a-48ae-b536-083c33d13d45. Dropping event network-vif-unplugged {{(pid=98473) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 08 12:20:25.130800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d7f7d807-da48-41e6-bb57-dd03012e90dd req-39091130-964c-4319-a169-be0b0fd67762 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034594 Apr 08 12:20:25.131441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 440/847] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:20:25 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 08 12:20:25.256674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-16fde438-46e0-4440-866a-3911ccb2d3b8 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.758789 Apr 08 12:20:25.257351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 408/848] 10.222.0.43 () {62 vars in 1354 bytes} [Thu Apr 8 12:20:24 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/os-volume_attachments => generated 188 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 12:20:25.368648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0c804d37-0277-494b-b593-da243807348a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:25.369206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0c804d37-0277-494b-b593-da243807348a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:25.377968 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c804d37-0277-494b-b593-da243807348a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:25.378543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c804d37-0277-494b-b593-da243807348a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:25.379393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c804d37-0277-494b-b593-da243807348a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:25.379902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c804d37-0277-494b-b593-da243807348a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:26.028363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0c804d37-0277-494b-b593-da243807348a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/os-volume_attachments/143d1a3d-cda4-47e8-961b-368991b57da2" status: 202 len: 0 microversion: 2.20 time: 0.663711 Apr 08 12:20:26.028974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 441/849] 10.222.0.43 () {60 vars in 1447 bytes} [Thu Apr 8 12:20:25 2021] DELETE /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/os-volume_attachments/143d1a3d-cda4-47e8-961b-368991b57da2 => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:20:26.134471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-33eab91a-0e65-4bb7-8c21-5687790aa3a5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:26.135095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-33eab91a-0e65-4bb7-8c21-5687790aa3a5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:26.144347 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33eab91a-0e65-4bb7-8c21-5687790aa3a5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:26.144867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33eab91a-0e65-4bb7-8c21-5687790aa3a5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:26.145684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33eab91a-0e65-4bb7-8c21-5687790aa3a5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:26.146180 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33eab91a-0e65-4bb7-8c21-5687790aa3a5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:26.363377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-33eab91a-0e65-4bb7-8c21-5687790aa3a5 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action" status: 202 len: 0 microversion: 2.20 time: 0.233036 Apr 08 12:20:26.366365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 409/850] 10.222.0.43 () {62 vars in 1309 bytes} [Thu Apr 8 12:20:26 2021] POST /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:20:26.373313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:26.373987 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:26.382465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:26.382941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:26.383852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:26.384241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:26.588455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:26.599457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:26.601404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:26.602831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e5fc2110-f4ec-44b5-97cd-ac1e087aa546 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1668 microversion: 2.20 time: 0.234251 Apr 08 12:20:26.605609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 442/851] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:26 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1668 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:27.625611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:27.626343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:27.634199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:27.634711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:27.636327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:27.636547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:27.739457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f8a9e8e1-7385-4f39-97a8-7cfd8bb8897a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:27.740594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f8a9e8e1-7385-4f39-97a8-7cfd8bb8897a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:27.749015 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8a9e8e1-7385-4f39-97a8-7cfd8bb8897a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:27.749530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8a9e8e1-7385-4f39-97a8-7cfd8bb8897a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:27.750648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8a9e8e1-7385-4f39-97a8-7cfd8bb8897a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:27.751147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8a9e8e1-7385-4f39-97a8-7cfd8bb8897a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:27.820233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f8a9e8e1-7385-4f39-97a8-7cfd8bb8897a tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084697 Apr 08 12:20:27.820764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 443/852] 10.222.0.43 () {58 vars in 1292 bytes} [Thu Apr 8 12:20:27 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:20:27.831872 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b1dc8e9e-c002-4ff0-9599-93f392ef30ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:27.832423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b1dc8e9e-c002-4ff0-9599-93f392ef30ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:27.840361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1dc8e9e-c002-4ff0-9599-93f392ef30ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:27.841035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1dc8e9e-c002-4ff0-9599-93f392ef30ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:27.841956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1dc8e9e-c002-4ff0-9599-93f392ef30ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:27.842578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1dc8e9e-c002-4ff0-9599-93f392ef30ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:27.911123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b1dc8e9e-c002-4ff0-9599-93f392ef30ad tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/c387bfb6-0972-4024-81a1-f392299cbccc" status: 200 len: 194 microversion: 2.1 time: 0.083117 Apr 08 12:20:27.911931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 444/853] 10.222.0.43 () {58 vars in 1403 bytes} [Thu Apr 8 12:20:27 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/c387bfb6-0972-4024-81a1-f392299cbccc => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:20:27.925146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:27.935676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:27.937399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:27.938804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b188202f-de14-416b-8035-7573c2e8deaa tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1670 microversion: 2.20 time: 0.318125 Apr 08 12:20:27.939436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 410/854] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:27 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1670 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:28.959196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:28.959885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:28.968844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:28.969355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:28.970454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:28.970700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:29.168828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:29.178329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:29.179983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:29.181187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e199ef10-b36c-4841-9e0d-d40d12158966 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.226094 Apr 08 12:20:29.181805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 445/855] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:28 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:29.704122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e2b51e2d-f73f-4303-8bee-3b537b32e226 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28bc136a-8c6e-475d-b4bd-7c8b3f8f7076"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:29.705441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e2b51e2d-f73f-4303-8bee-3b537b32e226 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:29.714478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2b51e2d-f73f-4303-8bee-3b537b32e226 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:29.715126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2b51e2d-f73f-4303-8bee-3b537b32e226 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:29.715998 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2b51e2d-f73f-4303-8bee-3b537b32e226 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:29.716502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2b51e2d-f73f-4303-8bee-3b537b32e226 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:30.201675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:30.203220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:30.211428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:30.212226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:30.213555 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:30.214245 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:30.428056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:30.439039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:30.440732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:30.442003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-97e3ecbd-4377-4a33-9bf4-383be4aec9b1 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.245267 Apr 08 12:20:30.442729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 446/856] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:30 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:31.461310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:31.461979 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:31.470984 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:31.471500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:31.472356 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:31.472850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:31.672922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:31.683495 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:31.685167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:31.686513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-eefe25a4-3608-496c-b4aa-181348aa9bd6 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.229167 Apr 08 12:20:31.687486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 447/857] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:31 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:32.709035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:32.710783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:32.719628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:32.720186 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:32.721043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:32.721540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:32.929412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:32.941266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:32.942976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:32.944225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f52098d2-4d39-4ea1-bd99-b10b799c961d tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.240916 Apr 08 12:20:32.945026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 448/858] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:32 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:33.963958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:33.964608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:33.972622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:33.973522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:33.974378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:33.974877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:34.294768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:34.305900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:34.308625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:34.309888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ec376ee8-ddb5-4cec-841b-6386ee8a5034 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.350246 Apr 08 12:20:34.310928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 449/859] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:33 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:35.329506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:35.330171 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:35.338116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:35.338681 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:35.340024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:35.340517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:35.551824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:35.561953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:35.563685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:35.564947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cdb273fb-bbaa-4fce-a10d-eea6d792928a tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.239649 Apr 08 12:20:35.565579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 450/860] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:35 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:36.584858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:36.585574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:36.594224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:36.594764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:36.595631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:36.596130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:36.805397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:36.815329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:36.817365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:36.818249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-37d2a8d8-b0ae-4772-b99e-1dad6cbd6520 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.237573 Apr 08 12:20:36.818894 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 451/861] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:36 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:37.837263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:37.837929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:37.846110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:37.846716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:37.847565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:37.848056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:38.052754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:38.063059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:38.064717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:38.065920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cf59eb9a-ed20-4383-8c8f-404ab8a0ee4f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.232654 Apr 08 12:20:38.066584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 452/862] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:37 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:39.085380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:39.086537 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:39.094689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:39.095206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:39.096052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:39.096548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:39.292913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:39.302451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:39.304121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:39.305343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c4af3435-bf43-4375-ba35-dd0a55250ccb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.224129 Apr 08 12:20:39.305962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 453/863] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:39 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:40.238989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e2b51e2d-f73f-4303-8bee-3b537b32e226 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.538674 Apr 08 12:20:40.239885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 411/864] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:20:29 2021] POST /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments => generated 194 bytes in 10541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:20:40.325618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:40.326291 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:40.337356 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:40.337816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:40.338747 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:40.339473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:40.551914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:40.562387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:40.564061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:40.565287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6b486964-b5b0-4b8d-a94e-1b0c962ce2dc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.244228 Apr 08 12:20:40.565900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 454/865] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:40 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:41.587116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:41.587876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:41.598852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:41.599366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:41.600207 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:41.600722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:41.813579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:41.825121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:41.827018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:41.828348 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-58b29685-2847-47b4-a545-ca637b1ff05f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.246472 Apr 08 12:20:41.829030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 412/866] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:41 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:42.848764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:42.849431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:42.858293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:42.858824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:42.859655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:42.860147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:43.056031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:43.066030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:43.067755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:43.068971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bdabfb2c-174b-40a6-8f78-458141418c52 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.224315 Apr 08 12:20:43.070051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 455/867] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:42 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:44.088858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:44.090285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:44.098868 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:44.099389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:44.100241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:44.100744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:44.294263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:44.303604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:44.305321 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:44.306574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fc29d4a2-9c69-4896-9d5a-eeff976a013c tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.221791 Apr 08 12:20:44.307191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 413/868] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:44 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:45.288021 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-7db4bb82-cfe6-4d6d-bd33-046d5379eeae req-5cf03440-98ce-4198-9050-6834f172585d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dd2b74-811a-48ae-b536-083c33d13d45", "name": "network-vif-plugged", "status": "completed", "tag": "fb2e14a6-43f6-49b1-b7b3-9f9fb1687767"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:45.289638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:20:45.289638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:20:45.299444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-7db4bb82-cfe6-4d6d-bd33-046d5379eeae req-5cf03440-98ce-4198-9050-6834f172585d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:45.299956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-7db4bb82-cfe6-4d6d-bd33-046d5379eeae req-5cf03440-98ce-4198-9050-6834f172585d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:45.318855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-7db4bb82-cfe6-4d6d-bd33-046d5379eeae req-5cf03440-98ce-4198-9050-6834f172585d service nova] Creating event network-vif-plugged:fb2e14a6-43f6-49b1-b7b3-9f9fb1687767 for instance c3dd2b74-811a-48ae-b536-083c33d13d45 on hv-cinder-78477 Apr 08 12:20:45.324388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-7db4bb82-cfe6-4d6d-bd33-046d5379eeae req-5cf03440-98ce-4198-9050-6834f172585d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040373 Apr 08 12:20:45.325178 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 456/869] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:20:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:45.327047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:45.327779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:45.336060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:45.336574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:45.337648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:45.337905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:45.611835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:45.623193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:45.624926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:45.626445 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9917cd9b-d35a-463e-98fd-c15b645e97e9 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.304084 Apr 08 12:20:45.627274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 414/870] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:45 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 12:20:46.645859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:46.646699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:46.655145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:46.655662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:46.656506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:46.657005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:46.860389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:46.870165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:46.873195 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:46.874583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cae9b92d-7134-4641-a184-dcc93d42c826 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1726 microversion: 2.20 time: 0.233095 Apr 08 12:20:46.875307 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 457/871] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:46 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1726 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:47.893302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:47.893971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:47.901881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:47.902422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:47.903265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:47.903763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:48.099693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-586cda91-e1f6-40ab-a20a-e51065e93d42 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:48.100730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-586cda91-e1f6-40ab-a20a-e51065e93d42 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:48.104727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:48.109938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-586cda91-e1f6-40ab-a20a-e51065e93d42 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:48.110480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-586cda91-e1f6-40ab-a20a-e51065e93d42 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:48.111322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-586cda91-e1f6-40ab-a20a-e51065e93d42 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:48.111808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-586cda91-e1f6-40ab-a20a-e51065e93d42 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:48.114922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:48.116639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:48.117895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-562a0792-b327-40de-b7a5-d79fada0c502 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1713 microversion: 2.20 time: 0.228639 Apr 08 12:20:48.118571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 415/872] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:20:47 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1713 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:20:48.182209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-586cda91-e1f6-40ab-a20a-e51065e93d42 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.086477 Apr 08 12:20:48.182893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 458/873] 10.222.0.43 () {58 vars in 1292 bytes} [Thu Apr 8 12:20:48 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:48.407981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5423ae55-2838-46ff-88e8-0666bca5c68c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:48.408531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5423ae55-2838-46ff-88e8-0666bca5c68c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:48.416471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5423ae55-2838-46ff-88e8-0666bca5c68c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:48.416989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5423ae55-2838-46ff-88e8-0666bca5c68c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:48.418109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5423ae55-2838-46ff-88e8-0666bca5c68c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:48.418637 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5423ae55-2838-46ff-88e8-0666bca5c68c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:48.487028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5423ae55-2838-46ff-88e8-0666bca5c68c tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/c387bfb6-0972-4024-81a1-f392299cbccc" status: 200 len: 194 microversion: 2.1 time: 0.083077 Apr 08 12:20:48.487607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 416/874] 10.222.0.43 () {58 vars in 1403 bytes} [Thu Apr 8 12:20:48 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/c387bfb6-0972-4024-81a1-f392299cbccc => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:48.497989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:48.498589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:48.506682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:48.507190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:48.508026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:48.508517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:48.680959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lazy-loading 'services' on Instance uuid 8047aad6-b96b-45e1-ada9-3c6063b5fb08 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:20:48.868170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-81ec5375-7446-4847-b9f5-b24f8ffa8206 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/c387bfb6-0972-4024-81a1-f392299cbccc" status: 202 len: 0 microversion: 2.1 time: 0.374170 Apr 08 12:20:48.868804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 459/875] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:20:48 2021] DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/c387bfb6-0972-4024-81a1-f392299cbccc => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:20:51.179267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2557bbc5-06f3-4186-8d69-43cf7527a4e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:51.179825 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2557bbc5-06f3-4186-8d69-43cf7527a4e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:51.188183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2557bbc5-06f3-4186-8d69-43cf7527a4e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:51.188699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2557bbc5-06f3-4186-8d69-43cf7527a4e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:51.189548 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2557bbc5-06f3-4186-8d69-43cf7527a4e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:51.190047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2557bbc5-06f3-4186-8d69-43cf7527a4e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:51.258210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2557bbc5-06f3-4186-8d69-43cf7527a4e3 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/28bc136a-8c6e-475d-b4bd-7c8b3f8f7076" status: 200 len: 194 microversion: 2.1 time: 0.083234 Apr 08 12:20:51.258904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 417/876] 10.222.0.43 () {58 vars in 1403 bytes} [Thu Apr 8 12:20:51 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/28bc136a-8c6e-475d-b4bd-7c8b3f8f7076 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:51.270566 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:51.271224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:51.280270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:51.280781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:51.281631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:51.282132 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:51.458174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lazy-loading 'services' on Instance uuid 8047aad6-b96b-45e1-ada9-3c6063b5fb08 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:20:51.657319 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ee59dc34-4fd7-4366-b616-79d21bd3eb12 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/28bc136a-8c6e-475d-b4bd-7c8b3f8f7076" status: 202 len: 0 microversion: 2.1 time: 0.391417 Apr 08 12:20:51.657958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 460/877] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:20:51 2021] DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08/os-volume_attachments/28bc136a-8c6e-475d-b4bd-7c8b3f8f7076 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:20:53.254150 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:53.254741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:53.263344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:53.263867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:53.264721 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:53.265229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:53.329893 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:20:53.536907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2e859995-1716-4b81-a27d-654fdd86a9f2 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 204 len: 0 microversion: 2.1 time: 0.286684 Apr 08 12:20:53.537559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 418/878] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:20:53 2021] DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:20:53.562029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:53.562873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:53.571174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:53.571690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:53.572539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:53.573039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:53.767005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:53.775880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-7f4d1a6e-4780-42f8-a547-4b5757a9bc92 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1671 microversion: 2.1 time: 0.219143 Apr 08 12:20:53.776589 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 461/879] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:20:53 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1671 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:20:54.795493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:54.796275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:54.804105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:54.804619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:54.805458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:54.805954 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:55.001834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:55.011244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-82987164-0e49-4de1-8929-04951b2bcc63 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1671 microversion: 2.1 time: 0.219704 Apr 08 12:20:55.011881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 419/880] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:20:54 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:20:56.029197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:56.029871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:56.038257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:56.038803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:56.039650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:56.040145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:56.171470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:56.180401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4fa03d1c-6c10-4ea9-a3ee-fdf97ba0b630 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1605 microversion: 2.1 time: 0.155878 Apr 08 12:20:56.181031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 462/881] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:20:56 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:20:56.851621 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-02f6f0b0-be8b-462d-9f70-7d784eb1314c req-8a760681-50e4-4416-aae4-f3d7cd154cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8047aad6-b96b-45e1-ada9-3c6063b5fb08", "name": "network-vif-deleted", "tag": "ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:20:56.853834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:20:56.853834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:20:56.865395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-02f6f0b0-be8b-462d-9f70-7d784eb1314c req-8a760681-50e4-4416-aae4-f3d7cd154cad service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:56.866202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-02f6f0b0-be8b-462d-9f70-7d784eb1314c req-8a760681-50e4-4416-aae4-f3d7cd154cad service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:56.886405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-02f6f0b0-be8b-462d-9f70-7d784eb1314c req-8a760681-50e4-4416-aae4-f3d7cd154cad service nova] Creating event network-vif-deleted:ba8c3aa4-fd8d-44fa-ab15-f7c77afbf38f for instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 on hv-cinder-78477 Apr 08 12:20:56.891565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-02f6f0b0-be8b-462d-9f70-7d784eb1314c req-8a760681-50e4-4416-aae4-f3d7cd154cad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044101 Apr 08 12:20:56.892466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 420/882] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:20:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:20:57.198945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:57.199606 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:57.207460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:57.208203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:57.208792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:57.209282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:57.282387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:57.282895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:57.283403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lazy-loading 'fault' on Instance uuid 8047aad6-b96b-45e1-ada9-3c6063b5fb08 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:20:57.346676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3bca9a02e384de89ed455e272f4ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e331e206224c7aad5f2f90f7059f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:20:57.358034 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2b9a4ced-2838-45af-96e6-4e4f56ec68b7 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 200 len: 1327 microversion: 2.1 time: 0.163120 Apr 08 12:20:57.358715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 463/883] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:20:57 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:20:58.377611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:58.378485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:20:58.387490 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:58.388001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:58.388827 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:20:58.389516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:20:58.442748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] HTTP exception thrown: Instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 could not be found. Apr 08 12:20:58.443421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Returning 404 to user: Instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:20:58.444325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4f11bd42-aff9-40d0-8223-00a8691bbf6e tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 404 len: 111 microversion: 2.1 time: 0.071795 Apr 08 12:20:58.444945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 421/884] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:20:58 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:20:58.454369 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e87d54ea-acc5-4970-b851-4f1baa4af478 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '.version_select at 0x7f225d9052f0>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:20:58.503731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e87d54ea-acc5-4970-b851-4f1baa4af478 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990375888" status: 202 len: 0 microversion: 2.1 time: 0.053217 Apr 08 12:20:58.504471 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 464/885] 10.222.0.43 () {58 vars in 1208 bytes} [Thu Apr 8 12:20:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990375888 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:21:02.366465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:02.367019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:02.375682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:02.376188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:02.377013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:02.377504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:02.433388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] HTTP exception thrown: Instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 could not be found. Apr 08 12:21:02.434052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Returning 404 to user: Instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:02.434973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ed10a905-0c96-4866-b2f0-c0b37213be97 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 404 len: 111 microversion: 2.1 time: 0.072582 Apr 08 12:21:02.435580 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 422/886] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:21:02 2021] DELETE /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:02.444100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:02.444767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 8047aad6-b96b-45e1-ada9-3c6063b5fb08] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:02.453300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:02.453808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:02.454663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:02.455156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:02.507374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] HTTP exception thrown: Instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 could not be found. Apr 08 12:21:02.508030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Returning 404 to user: Instance 8047aad6-b96b-45e1-ada9-3c6063b5fb08 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:02.508913 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d4375498-bb6b-43d8-8814-a3856a70ee66 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08" status: 404 len: 111 microversion: 2.1 time: 0.068904 Apr 08 12:21:02.509503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 465/887] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:02 2021] GET /compute/v2.1/servers/8047aad6-b96b-45e1-ada9-3c6063b5fb08 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:03.815723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:03.816282 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:03.824300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:03.824821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:03.825663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:03.826161 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:03.878703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] HTTP exception thrown: Instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b could not be found. Apr 08 12:21:03.879362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Returning 404 to user: Instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:03.880251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-581f47d9-18c8-414c-b0c3-84b3164cb759 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 404 len: 111 microversion: 2.1 time: 0.068567 Apr 08 12:21:03.880838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 423/888] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:21:03 2021] DELETE /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:03.889217 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:03.889894 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] [instance: 5318a0d2-3723-47d4-9ec0-700cbb4cab5b] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:03.897804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:03.898356 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:03.899177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:03.899672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:03.952135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] HTTP exception thrown: Instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b could not be found. Apr 08 12:21:03.952787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] Returning 404 to user: Instance 5318a0d2-3723-47d4-9ec0-700cbb4cab5b could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:03.953670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c61fc488-0a28-44f9-ac2b-73ee6e817366 tempest-AttachVolumeTestJSON-1233716692 tempest-AttachVolumeTestJSON-1233716692-project] 10.222.0.43 "GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b" status: 404 len: 111 microversion: 2.1 time: 0.068558 Apr 08 12:21:03.954262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 466/889] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:03 2021] GET /compute/v2.1/servers/5318a0d2-3723-47d4-9ec0-700cbb4cab5b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:21.409174 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:21.409744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:21.418782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:21.419302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:21.420163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:21.420660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:21.485504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:21:21.737216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cf9d6b16-4695-4845-8744-8e1eb2b29cdc tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 204 len: 0 microversion: 2.20 time: 0.331692 Apr 08 12:21:21.737800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 424/890] 10.222.0.43 () {60 vars in 1270 bytes} [Thu Apr 8 12:21:21 2021] DELETE /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 12:21:21.746582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:21.747396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:21.755782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:21.756366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:21.757315 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:21.757809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:21.959638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:21.969785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:21.971467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:21.972665 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-041ea5cd-6dfe-495d-804d-6446a0da916f tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.230251 Apr 08 12:21:21.973276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 467/891] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:21:21 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:21:22.994083 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:22.994838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:23.005397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:23.005938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:23.006880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:23.007378 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:23.205808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:23.216072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:23.217786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:23.219085 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-84cb3458-48a2-4f3e-8f44-346c08e37674 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.229771 Apr 08 12:21:23.219705 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 425/892] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:21:22 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:21:24.238796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:24.239500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:24.247960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:24.248474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:24.249310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:24.249804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:24.452920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:24.462485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:24.464188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:24.465405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2fda5a88-6879-4433-87ea-a6004d28a0ba tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.230706 Apr 08 12:21:24.466020 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 468/893] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:21:24 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:21:25.484854 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:25.485563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:25.493481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:25.493991 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:25.494842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:25.495336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:25.693129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:25.703101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:25.704767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:25.705971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-27575482-6882-476b-b2f4-2fe4d60883cb tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1719 microversion: 2.20 time: 0.225410 Apr 08 12:21:25.706602 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 426/894] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:21:25 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:21:26.725553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:26.726159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:26.735482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:26.735993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:26.736848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:26.737337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:26.866678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:26.876517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:26.878228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:26.879474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fda986ed-e366-429f-a833-772cfdf2eab4 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1652 microversion: 2.20 time: 0.158221 Apr 08 12:21:26.880093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 469/895] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:21:26 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:21:27.398414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-1c8fd28e-d075-4507-8e76-174624470629 req-337f0d59-c7a7-421b-a64a-377db8fccf30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dd2b74-811a-48ae-b536-083c33d13d45", "name": "network-vif-deleted", "tag": "fb2e14a6-43f6-49b1-b7b3-9f9fb1687767"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:21:27.400232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:21:27.400232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:21:27.409644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1c8fd28e-d075-4507-8e76-174624470629 req-337f0d59-c7a7-421b-a64a-377db8fccf30 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:27.410162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-1c8fd28e-d075-4507-8e76-174624470629 req-337f0d59-c7a7-421b-a64a-377db8fccf30 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:27.429235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-1c8fd28e-d075-4507-8e76-174624470629 req-337f0d59-c7a7-421b-a64a-377db8fccf30 service nova] Creating event network-vif-deleted:fb2e14a6-43f6-49b1-b7b3-9f9fb1687767 for instance c3dd2b74-811a-48ae-b536-083c33d13d45 on hv-cinder-78477 Apr 08 12:21:27.436297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-1c8fd28e-d075-4507-8e76-174624470629 req-337f0d59-c7a7-421b-a64a-377db8fccf30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041763 Apr 08 12:21:27.437644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 427/896] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:21:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:21:27.899779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:27.900467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:27.908760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:27.909283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:27.910136 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:27.910671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:27.998118 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:27.998660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:27.999337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lazy-loading 'fault' on Instance uuid c3dd2b74-811a-48ae-b536-083c33d13d45 {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:21:28.084272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:28.094803 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:28.096664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '003e0d5d02fb4268a1122538eb880dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fb1b381792465a82ef64be541e5500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:28.097927 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6c760bf3-3bbc-45f5-944c-9a04196fc937 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 200 len: 1368 microversion: 2.20 time: 0.202267 Apr 08 12:21:28.098575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 470/897] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:21:27 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 12:21:29.118109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:29.119122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:29.131849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:29.132371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:29.133219 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:29.133713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:29.188727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] HTTP exception thrown: Instance c3dd2b74-811a-48ae-b536-083c33d13d45 could not be found. Apr 08 12:21:29.192329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Returning 404 to user: Instance c3dd2b74-811a-48ae-b536-083c33d13d45 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:29.192329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1a84b651-5a43-48cf-8848-ffbfa09ae345 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 404 len: 111 microversion: 2.20 time: 0.076813 Apr 08 12:21:29.192329 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 428/898] 10.222.0.43 () {60 vars in 1267 bytes} [Thu Apr 8 12:21:29 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 12:21:29.199840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-53a53098-3e44-42d5-86ae-de68194b4028 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '.version_select at 0x7f22583a06a8>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:29.235689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-53a53098-3e44-42d5-86ae-de68194b4028 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424360264" status: 204 len: 0 microversion: 2.20 time: 0.039678 Apr 08 12:21:29.236482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 471/899] 10.222.0.43 () {60 vars in 1249 bytes} [Thu Apr 8 12:21:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424360264 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 12:21:32.100498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:32.101058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:32.109086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:32.109610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:32.110492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:32.117533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:32.167525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] HTTP exception thrown: Instance c3dd2b74-811a-48ae-b536-083c33d13d45 could not be found. Apr 08 12:21:32.168206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Returning 404 to user: Instance c3dd2b74-811a-48ae-b536-083c33d13d45 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:32.169108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ec7717a7-c2f3-473d-a365-f6666112e162 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 404 len: 111 microversion: 2.1 time: 0.072992 Apr 08 12:21:32.172959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 429/900] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:21:32 2021] DELETE /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:32.178276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:32.178977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: c3dd2b74-811a-48ae-b536-083c33d13d45] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:32.187781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:32.188297 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:32.189173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:32.189669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:32.243079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] HTTP exception thrown: Instance c3dd2b74-811a-48ae-b536-083c33d13d45 could not be found. Apr 08 12:21:32.243748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Returning 404 to user: Instance c3dd2b74-811a-48ae-b536-083c33d13d45 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:32.244645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fd430bf7-f515-4d47-9ce6-2bb4ae391c6e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45" status: 404 len: 111 microversion: 2.1 time: 0.070410 Apr 08 12:21:32.245263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 472/901] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:32 2021] GET /compute/v2.1/servers/c3dd2b74-811a-48ae-b536-083c33d13d45 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:33.588639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:33.589784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:33.598808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:33.599390 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:33.600483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:33.601057 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:33.655850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] HTTP exception thrown: Instance 704586d7-ad35-414f-af0c-5835b542f260 could not be found. Apr 08 12:21:33.656530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Returning 404 to user: Instance 704586d7-ad35-414f-af0c-5835b542f260 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:33.657452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e057b508-83cd-423a-bfd1-6fb776f71a84 tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "DELETE /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 404 len: 111 microversion: 2.1 time: 0.073257 Apr 08 12:21:33.658065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 430/902] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:21:33 2021] DELETE /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:33.666591 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:33.667421 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] [instance: 704586d7-ad35-414f-af0c-5835b542f260] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:33.675896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:33.676412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:33.677264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:33.677742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:33.741831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] HTTP exception thrown: Instance 704586d7-ad35-414f-af0c-5835b542f260 could not be found. Apr 08 12:21:33.742543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] Returning 404 to user: Instance 704586d7-ad35-414f-af0c-5835b542f260 could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:21:33.743458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-79dc673c-5ed2-46ee-98b9-dab429a0143e tempest-AttachVolumeShelveTestJSON-1835679924 tempest-AttachVolumeShelveTestJSON-1835679924-project] 10.222.0.43 "GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260" status: 404 len: 111 microversion: 2.1 time: 0.080987 Apr 08 12:21:33.744576 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 473/903] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:33 2021] GET /compute/v2.1/servers/704586d7-ad35-414f-af0c-5835b542f260 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:21:48.068077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:21:48.068674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:48.077363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:48.077867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:48.078750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:48.079252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:48.142146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lazy-loading 'flavor' on Instance uuid a6deb0bf-27c9-49e9-b44b-7871e994fb76 {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:21:48.375350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ffe45c3e-9600-4d56-9a16-eb1f474255bc tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "POST /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76/action" status: 202 len: 0 microversion: 2.1 time: 0.311315 Apr 08 12:21:48.376269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 431/904] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:21:48 2021] POST /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:21:48.385770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:48.386484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:48.395140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:48.395649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:48.396500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:48.396997 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:48.590227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:48.599723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6f5992d4-53cc-4190-af13-cb6d428b1fe7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.218658 Apr 08 12:21:48.600341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 474/905] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:48 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:49.619058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:49.619834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:49.628862 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:49.629375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:49.630205 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:49.630726 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:49.829861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:49.838788 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6817e830-93d5-4930-9e9e-d5724c11ae4e tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.224292 Apr 08 12:21:49.839411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 432/906] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:49 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:50.857843 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:50.858539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:50.866530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:50.867035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:50.867856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:50.868342 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:51.070328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:51.079362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-75cfdaaf-27a6-4671-8dd4-b5be52efdbaa tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.226145 Apr 08 12:21:51.083255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 475/907] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:50 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:52.099403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:52.100082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:52.108436 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:52.108944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:52.109775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:52.110269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:52.308844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:52.317919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0604b100-a6d5-4518-8770-1bed048256be tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.222574 Apr 08 12:21:52.318613 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 433/908] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:52 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:53.337367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:53.338052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:53.346733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:53.347269 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:53.348117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:53.348614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:53.544903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:53.553725 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1737f91b-eb36-4745-8436-a8bd170eb04f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.220502 Apr 08 12:21:53.554363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 476/909] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:53 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:54.572427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:54.573100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:54.580959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:54.581482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:54.582350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:54.582971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:54.788155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:54.798040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-692eaf58-805e-42d6-8353-65b53aa79099 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.229695 Apr 08 12:21:54.798694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 434/910] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:54 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:55.817091 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:55.817759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:55.826485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:55.827160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:55.828012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:55.828506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:56.024928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:56.034466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-08790b1b-5846-489e-b2f0-1617ce5557a8 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.221437 Apr 08 12:21:56.035096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 477/911] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:55 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:57.052734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:57.053406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:57.061491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:57.061951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:57.063374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:57.063868 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:57.260216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:57.268992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-abe44294-8dc9-4d83-852d-7e015eff9fb5 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.220293 Apr 08 12:21:57.269615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 435/912] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:57 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:58.287732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:58.289273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:58.297154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:58.297588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:58.298456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:58.298955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:58.500501 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:58.509876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-863b9c34-9db9-4e5a-be0f-0845198a7370 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.226284 Apr 08 12:21:58.510532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 478/913] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:58 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:21:59.535680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:21:59.536357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:21:59.544263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:59.544784 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:59.545609 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:21:59.546108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:21:59.741487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:21:59.751769 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f1786600-7e5d-4275-b48d-1c7e41a25e98 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.220681 Apr 08 12:21:59.752406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 436/914] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:21:59 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:00.770615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:00.771305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:00.779284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:00.779797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:00.780632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:00.781122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:00.983110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:00.989543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5d5f1cf1-d162-4510-a93c-354288819fc9 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.223538 Apr 08 12:22:00.990154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 479/915] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:00 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:02.007695 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:02.008379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:02.016684 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:02.017185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:02.018029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:02.018586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:02.226727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:02.229350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-23bc89be-7767-4c85-8776-fd2a64d9405a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.225719 Apr 08 12:22:02.229975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 437/916] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:02 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:22:03.248324 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:03.249030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:03.257699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:03.258200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:03.259060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:03.259545 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:03.480849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:03.494288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a1454c3c-d9e0-4621-a830-ad537faf57e2 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.250022 Apr 08 12:22:03.505722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 480/917] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:03 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:04.513221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:04.513892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:04.521925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:04.522444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:04.523311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:04.523802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:04.724024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:04.732982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bf1c0a16-6a6a-469c-8e31-574cf85d66ab tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1570 microversion: 2.1 time: 0.223998 Apr 08 12:22:04.733622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 438/918] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:04 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:04.752383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c9291599-ae2f-4497-a344-babac1666de4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:22:04.753012 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c9291599-ae2f-4497-a344-babac1666de4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:04.761167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9291599-ae2f-4497-a344-babac1666de4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:04.761689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9291599-ae2f-4497-a344-babac1666de4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:04.762596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9291599-ae2f-4497-a344-babac1666de4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:04.763099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c9291599-ae2f-4497-a344-babac1666de4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:05.088099 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c9291599-ae2f-4497-a344-babac1666de4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "POST /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76/action" status: 202 len: 0 microversion: 2.1 time: 0.340815 Apr 08 12:22:05.088758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 481/919] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:22:04 2021] POST /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:22:05.097791 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:05.098492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:05.106565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:05.107084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:05.107928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:05.108427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:05.335662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:05.349688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bb48c3ad-49c7-4483-9c6a-4c703af55469 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1518 microversion: 2.1 time: 0.256205 Apr 08 12:22:05.357283 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 439/920] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:05 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:06.368608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:06.369222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:06.378098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:06.378699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:06.379551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:06.380054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:06.580062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:06.588859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0ecfc281-a52e-40e1-90d8-cde7d8d229c4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1520 microversion: 2.1 time: 0.224438 Apr 08 12:22:06.589480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 482/921] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:06 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:07.607453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:07.608678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:07.616511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-f85ca79d-b5eb-44b8-a9cc-f492f5a270c2 req-a69239e6-5d9c-4547-a544-9de9ad20f993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6deb0bf-27c9-49e9-b44b-7871e994fb76", "name": "network-vif-unplugged", "status": "completed", "tag": "7aa28d27-c593-4d1f-bd76-5d3dccb52b3c"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:22:07.618430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:07.618995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:22:07.618995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:22:07.619526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:07.620582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:07.621276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:07.628521 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-f85ca79d-b5eb-44b8-a9cc-f492f5a270c2 req-a69239e6-5d9c-4547-a544-9de9ad20f993 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:07.629023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-f85ca79d-b5eb-44b8-a9cc-f492f5a270c2 req-a69239e6-5d9c-4547-a544-9de9ad20f993 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:07.647985 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.compute.server_external_events [req-f85ca79d-b5eb-44b8-a9cc-f492f5a270c2 req-a69239e6-5d9c-4547-a544-9de9ad20f993 service nova] Unable to find a host for instance a6deb0bf-27c9-49e9-b44b-7871e994fb76. Dropping event network-vif-unplugged {{(pid=98473) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 08 12:22:07.660386 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-f85ca79d-b5eb-44b8-a9cc-f492f5a270c2 req-a69239e6-5d9c-4547-a544-9de9ad20f993 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049344 Apr 08 12:22:07.664901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 483/922] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:22:07 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 08 12:22:08.411139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:08.420484 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-13196898-600f-4e5f-bce5-ca7c3417d8d4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1520 microversion: 2.1 time: 0.816879 Apr 08 12:22:08.421111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 440/923] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:07 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1520 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:09.439654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:09.440483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:09.449473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:09.450072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:09.451034 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:09.451619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:09.686478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:09.696160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e2490ac7-cc99-429f-86fb-5f50bba37e97 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1576 microversion: 2.1 time: 0.260763 Apr 08 12:22:09.696787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 484/924] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:09 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:10.715664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:10.716048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:10.724317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:10.724834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:10.725663 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:10.726151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:11.263608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:11.273228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-27018c3e-05f8-4cf5-abed-571c0e9c2d90 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1576 microversion: 2.1 time: 0.562099 Apr 08 12:22:11.273867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 441/925] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:10 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1576 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:12.291563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:12.292242 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:12.300454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:12.300967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:12.301811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:12.302313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:12.499525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:12.509253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-079c5833-a0aa-43b5-850c-3f7cf5713a64 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1576 microversion: 2.1 time: 0.221710 Apr 08 12:22:12.509876 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 485/926] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:12 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:13.528498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:13.529194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:13.537947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:13.538534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:13.539380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:13.539868 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:13.740617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:13.749718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cb234519-f9e8-4c43-9dce-d184c7785e2a tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1576 microversion: 2.1 time: 0.225324 Apr 08 12:22:13.751343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 442/927] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:13 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:14.767376 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:14.768498 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:14.776810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:14.777317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:14.778158 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:14.778718 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:14.977189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:14.987010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-98dd18f0-82b5-43dc-9a18-f3ea1ed8f356 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1576 microversion: 2.1 time: 0.223794 Apr 08 12:22:14.987623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 486/928] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:14 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:16.005931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:16.006637 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:16.014397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:16.014917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:16.016162 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:16.016654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:16.220351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:16.229755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bb6a8be0-070d-47f2-a498-1d45b5db9df4 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1576 microversion: 2.1 time: 0.228051 Apr 08 12:22:16.230396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 443/929] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:15 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:17.249687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:22:17.250670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:22:17.259668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:17.260530 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:17.262164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:17.264336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:17.487166 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:22:17.496372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-688ce654-0aff-4bd9-a3f6-ec4719355401 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1563 microversion: 2.1 time: 0.251630 Apr 08 12:22:17.496995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 487/930] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:22:17 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:22:19.844655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-86c86b02-cef5-42af-9387-a348282751dc req-1513cbbe-5129-48c5-ae9b-3a1df9ee252c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6deb0bf-27c9-49e9-b44b-7871e994fb76", "name": "network-vif-plugged", "status": "completed", "tag": "7aa28d27-c593-4d1f-bd76-5d3dccb52b3c"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:22:19.846359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:22:19.846359 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:22:19.855045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-86c86b02-cef5-42af-9387-a348282751dc req-1513cbbe-5129-48c5-ae9b-3a1df9ee252c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:22:19.855553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-86c86b02-cef5-42af-9387-a348282751dc req-1513cbbe-5129-48c5-ae9b-3a1df9ee252c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:22:19.872793 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-86c86b02-cef5-42af-9387-a348282751dc req-1513cbbe-5129-48c5-ae9b-3a1df9ee252c service nova] Creating event network-vif-plugged:7aa28d27-c593-4d1f-bd76-5d3dccb52b3c for instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 on hv-cinder-78477 Apr 08 12:22:19.879296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-86c86b02-cef5-42af-9387-a348282751dc req-1513cbbe-5129-48c5-ae9b-3a1df9ee252c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038608 Apr 08 12:22:19.879873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 444/931] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:22:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:23:09.147263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:23:09.147841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:23:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:23:10.194262 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-13148419-7313-411e-8cad-fdc7211e9394 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Action: 'create', calling method: .version_select at 0x7f22585fc598>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1775416410"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:10.218775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-13148419-7313-411e-8cad-fdc7211e9394 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for project 5174f889b4cf4def811b78439275f602. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:23:10.223028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-13148419-7313-411e-8cad-fdc7211e9394 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for user 50b370fd6c2b4462a4199830f771ea1c and project 5174f889b4cf4def811b78439275f602. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:23:10.488972 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-13148419-7313-411e-8cad-fdc7211e9394 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for project 5174f889b4cf4def811b78439275f602. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:23:10.493797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-13148419-7313-411e-8cad-fdc7211e9394 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for user 50b370fd6c2b4462a4199830f771ea1c and project 5174f889b4cf4def811b78439275f602. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:23:10.511689 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-13148419-7313-411e-8cad-fdc7211e9394 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.617858 Apr 08 12:23:10.512533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 488/932] 10.222.0.43 () {60 vars in 1148 bytes} [Thu Apr 8 12:23:09 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:10.964664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cdf2619a-498f-4d04-86a4-e49920cb373d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 08 12:23:10.970333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-871943909", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "090d0cca-d772-4818-b41a-7784a21aa522"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:11.053252 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] validate_networks() for [('090d0cca-d772-4818-b41a-7784a21aa522', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:23:11.767645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:23:11.768130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:23:11.768665 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:23:11.769138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:23:11.769612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:23:11.778917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:11.779432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:11.780349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:11.781687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:11.801563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Getting quotas for project 77de47205a4543c1992a0e5acc27ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:23:11.806593 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Getting quotas for user 3c5acdf20a3c498f85baed149717c07b and project 77de47205a4543c1992a0e5acc27ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:23:11.818633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:23:11.821360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:23:11.900910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6f2574e7-09ea-48af-9a5e-7b93e6ba9052 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937585 Apr 08 12:23:11.902061 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 445/933] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:23:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:23:11.913596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f7d89f70-e33c-44e4-a7dc-45545a6d5e5b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:11.914416 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f7d89f70-e33c-44e4-a7dc-45545a6d5e5b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:12.011840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f7d89f70-e33c-44e4-a7dc-45545a6d5e5b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:12.022241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f7d89f70-e33c-44e4-a7dc-45545a6d5e5b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1218 microversion: 2.1 time: 0.112423 Apr 08 12:23:12.023010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 489/934] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:11 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:13.051634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:13.052310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:13.062840 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:13.063355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:13.064309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:13.064813 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:13.101794 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] [cdf2619a-498f-4d04-86a4-e49920cb373d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 53488. Apr 08 12:23:13.203870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:13.213071 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-26b86c04-3a63-418b-b0d7-47363ce8a44d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1214 microversion: 2.1 time: 0.175815 Apr 08 12:23:13.213705 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 446/935] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:13 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:14.233799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:14.236013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:14.258510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:14.260249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:14.262902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:14.263426 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:14.520068 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:14.540615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-36a519e0-6380-4233-8236-7ed407561e34 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1288 microversion: 2.1 time: 0.302857 Apr 08 12:23:14.540615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 490/936] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:14 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1288 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:15.549915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:15.550711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:15.558960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:15.559473 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:15.560316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:15.560810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:16.447571 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:16.459488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d4aded3e-36bb-4f56-b293-c5851d2bc7ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.913725 Apr 08 12:23:16.462776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 447/937] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:15 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:17.157263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-f069f124-b88f-4486-881b-82b09c47c096 req-ca284d4e-7d52-4d5d-bc27-e199f255ec04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4994f9-95be-4a29-8b20-985d875fd0e5", "tag": "04461e90-6760-4454-b40f-bf4782edc612"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:17.158909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:23:17.158909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:23:17.168218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-f069f124-b88f-4486-881b-82b09c47c096 req-ca284d4e-7d52-4d5d-bc27-e199f255ec04 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:17.168732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-f069f124-b88f-4486-881b-82b09c47c096 req-ca284d4e-7d52-4d5d-bc27-e199f255ec04 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:17.189341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-f069f124-b88f-4486-881b-82b09c47c096 req-ca284d4e-7d52-4d5d-bc27-e199f255ec04 service nova] Creating event network-changed:04461e90-6760-4454-b40f-bf4782edc612 for instance 7a4994f9-95be-4a29-8b20-985d875fd0e5 on hv-cinder-78477 Apr 08 12:23:17.194604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-f069f124-b88f-4486-881b-82b09c47c096 req-ca284d4e-7d52-4d5d-bc27-e199f255ec04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041426 Apr 08 12:23:17.195290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 491/938] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:23:17.481344 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:17.482032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:17.490397 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:17.490924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:17.491773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:17.492284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:17.788002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:17.797522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aedfcbaf-b4c2-4b2d-9dc1-cc2f184cf416 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.320292 Apr 08 12:23:17.798127 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 448/939] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:17 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:18.817917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:18.818731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:18.827075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:18.827785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:18.828645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:18.829146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:19.047729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:19.056808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aab00f55-49de-4674-935d-f036bb9bea5c tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.243563 Apr 08 12:23:19.057565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 492/940] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:18 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:20.077273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:20.090468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:20.090468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:20.090468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:20.090468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:20.091029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:20.293394 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:20.302254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-33e3650e-78ec-414c-9056-080f1cf6328d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.229750 Apr 08 12:23:20.302899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 449/941] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:20 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:23:21.320587 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:21.321261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:21.329525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:21.330046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:21.330965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:21.331456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:21.534236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:21.543116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b608f930-1dc1-477a-a6e1-349686c4f7c6 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.226598 Apr 08 12:23:21.543734 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 493/942] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:21 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:22.561213 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:22.562838 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:22.570618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:22.571135 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:22.572148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:22.572700 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:22.767878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:22.777644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-493af5de-f8b6-4fb7-a5db-8d8a667286f1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.220468 Apr 08 12:23:22.778279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 450/943] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:22 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:23.797770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:23.798696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:23.806895 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:23.807402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:23.808230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:23.808722 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:24.009457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:24.018460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-214bdfbb-6e0f-4ea1-bc38-f4af8a9e9da3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.225180 Apr 08 12:23:24.019100 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 494/944] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:23 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:24.231990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-00e0c628-bce1-4769-a060-20639993b7f3 req-ab73c8e1-ca2b-43a3-a221-1da0777c5984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4994f9-95be-4a29-8b20-985d875fd0e5", "name": "network-vif-plugged", "status": "completed", "tag": "04461e90-6760-4454-b40f-bf4782edc612"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:24.234782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:23:24.234782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:23:24.243540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-00e0c628-bce1-4769-a060-20639993b7f3 req-ab73c8e1-ca2b-43a3-a221-1da0777c5984 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:24.244048 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-00e0c628-bce1-4769-a060-20639993b7f3 req-ab73c8e1-ca2b-43a3-a221-1da0777c5984 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:24.264760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-00e0c628-bce1-4769-a060-20639993b7f3 req-ab73c8e1-ca2b-43a3-a221-1da0777c5984 service nova] Creating event network-vif-plugged:04461e90-6760-4454-b40f-bf4782edc612 for instance 7a4994f9-95be-4a29-8b20-985d875fd0e5 on hv-cinder-78477 Apr 08 12:23:24.270129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-00e0c628-bce1-4769-a060-20639993b7f3 req-ab73c8e1-ca2b-43a3-a221-1da0777c5984 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043774 Apr 08 12:23:24.270821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 451/945] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:23:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:23:25.036028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:25.036694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:25.044492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:25.045042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:25.045890 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:25.046405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:25.239793 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:25.248402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a11f1dfa-2d2c-43ed-be54-0570174ca2c3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1318 microversion: 2.1 time: 0.216437 Apr 08 12:23:25.249035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 495/946] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:25 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:26.268761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:26.269563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:26.277633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:26.278141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:26.279008 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:26.279503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:26.474439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:26.483188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e60db101-0e47-4486-b76c-9df0bb206431 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1506 microversion: 2.1 time: 0.219637 Apr 08 12:23:26.483799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 452/947] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:26 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:29.092179 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2145369009", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1775416410", "security_groups": [{"name": "tempest-secgroup-smoke-332410541"}], "block_device_mapping_v2": [{"uuid": "6d2430a3-f912-4221-bf83-ca7384a503e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f160ec1-7ce7-4365-ac22-b0d5421f97ed"}]}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:29.245664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] validate_networks() for [('7f160ec1-7ce7-4365-ac22-b0d5421f97ed', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:23:29.948156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:23:29.948632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:23:29.949173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:23:29.949634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:23:29.950140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:23:29.959475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:29.960023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:29.960902 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:29.961468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:29.979709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for project 5174f889b4cf4def811b78439275f602. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:23:29.984601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for user 50b370fd6c2b4462a4199830f771ea1c and project 5174f889b4cf4def811b78439275f602. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:23:30.109855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:23:30.109855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d2430a3-f912-4221-bf83-ca7384a503e0',volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:23:30.378026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-27f7108f-b6c1-4c68-a2c6-d1bd41fc06fb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.289764 Apr 08 12:23:30.378852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 496/948] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:23:29 2021] POST /compute/v2.1/servers => generated 405 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:23:30.389550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eef4d57a-a0ff-4814-a666-d41a39f55c40 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:30.390214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eef4d57a-a0ff-4814-a666-d41a39f55c40 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:30.487783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-eef4d57a-a0ff-4814-a666-d41a39f55c40 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:30.495990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-eef4d57a-a0ff-4814-a666-d41a39f55c40 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1095 microversion: 2.1 time: 0.110538 Apr 08 12:23:30.496654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 453/949] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:30 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1095 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:31.514873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:31.515668 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:31.524367 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:31.524864 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:31.525930 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:31.526457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:31.658516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:31.667553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0360a98d-5d56-43f2-bca6-923b1a444205 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1193 microversion: 2.1 time: 0.156843 Apr 08 12:23:31.668173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 497/950] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:31 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1193 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:32.688249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:32.689567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:32.702939 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:32.703937 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:32.705087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:32.705832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:32.711579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:32.712151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:32.722949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:32.724287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:32.725154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:32.726389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:32.819062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:23:32.862244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:32.875977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-61375385-52c3-4b9f-b740-810f7f542365 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1211 microversion: 2.1 time: 0.193266 Apr 08 12:23:32.886702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 454/951] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:32 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1211 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:32.970986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-caec04e1-e261-417d-9a57-a317a954189e req-70ec318b-4dc0-441e-a6af-899b70e3a5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6deb0bf-27c9-49e9-b44b-7871e994fb76", "tag": "7aa28d27-c593-4d1f-bd76-5d3dccb52b3c"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:32.973108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:23:32.973108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:23:32.985139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-caec04e1-e261-417d-9a57-a317a954189e req-70ec318b-4dc0-441e-a6af-899b70e3a5b0 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:32.986128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-caec04e1-e261-417d-9a57-a317a954189e req-70ec318b-4dc0-441e-a6af-899b70e3a5b0 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:33.008465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-caec04e1-e261-417d-9a57-a317a954189e req-70ec318b-4dc0-441e-a6af-899b70e3a5b0 service nova] Creating event network-changed:7aa28d27-c593-4d1f-bd76-5d3dccb52b3c for instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 on hv-cinder-78477 Apr 08 12:23:33.015043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-caec04e1-e261-417d-9a57-a317a954189e req-70ec318b-4dc0-441e-a6af-899b70e3a5b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128212 Apr 08 12:23:33.015915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 455/952] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:23:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:23:33.091250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dcd57e21-1916-4e9a-9bc1-27098cd3ff8f tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 204 len: 0 microversion: 2.1 time: 0.385856 Apr 08 12:23:33.095808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 498/953] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:23:32 2021] DELETE /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:23:33.101820 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:33.102661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:33.111627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:33.112274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:33.113029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:33.113618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:33.895846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:33.896618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:33.906019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:33.906634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:33.907514 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:33.908001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:34.053778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:34.064076 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-70a48f4f-219e-4269-9013-5a8a3481db3b tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1569 microversion: 2.1 time: 0.966659 Apr 08 12:23:34.064915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 456/954] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:33 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1569 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:34.214681 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:34.227830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dc611ed6-2f06-4fd4-a7e4-b502a84c126c tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.336293 Apr 08 12:23:34.228971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 499/955] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:33 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:35.083353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:35.084007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:35.092133 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:35.092772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:35.094037 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:35.094546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:35.247103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:35.253043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:35.256992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:35.257649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:35.258645 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:35.259238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:35.474989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:35.484960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3faee01f-6607-497f-81ee-c8eae30abd51 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1450 microversion: 2.1 time: 0.405580 Apr 08 12:23:35.485934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 457/956] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:35 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1450 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:35.806013 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:35.815993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6284c63b-a23b-4e5a-af21-8621a5078a8e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.573099 Apr 08 12:23:35.816572 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 500/957] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:35 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:36.114155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d6fda3b4-7de5-470a-91b0-4ce3ca2c51eb req-d7d14af2-23cb-4604-afe2-3c9cd108c855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375ccd7f-c302-4444-85aa-7b4ab2af3a6e", "tag": "0d964002-0b3f-40c6-a636-560a76b20e7d"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:36.116123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:23:36.116123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:23:36.126955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d6fda3b4-7de5-470a-91b0-4ce3ca2c51eb req-d7d14af2-23cb-4604-afe2-3c9cd108c855 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:36.127438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d6fda3b4-7de5-470a-91b0-4ce3ca2c51eb req-d7d14af2-23cb-4604-afe2-3c9cd108c855 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:36.164492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d6fda3b4-7de5-470a-91b0-4ce3ca2c51eb req-d7d14af2-23cb-4604-afe2-3c9cd108c855 service nova] Creating event network-changed:0d964002-0b3f-40c6-a636-560a76b20e7d for instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e on hv-cinder-78477 Apr 08 12:23:36.171188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d6fda3b4-7de5-470a-91b0-4ce3ca2c51eb req-d7d14af2-23cb-4604-afe2-3c9cd108c855 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066952 Apr 08 12:23:36.172148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 458/958] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:23:36.486623 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-c37373ca-7c33-4e6d-a8cf-28542e0ed257 req-4c8e5b47-7fea-42c9-9990-ad1f651954b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6deb0bf-27c9-49e9-b44b-7871e994fb76", "name": "network-vif-deleted", "tag": "7aa28d27-c593-4d1f-bd76-5d3dccb52b3c"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:36.488596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:23:36.488596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:23:36.497861 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-c37373ca-7c33-4e6d-a8cf-28542e0ed257 req-4c8e5b47-7fea-42c9-9990-ad1f651954b9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:36.501753 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-c37373ca-7c33-4e6d-a8cf-28542e0ed257 req-4c8e5b47-7fea-42c9-9990-ad1f651954b9 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:36.505512 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:36.506325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:36.516738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:36.517187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:36.518267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:36.518831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:36.520975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-c37373ca-7c33-4e6d-a8cf-28542e0ed257 req-4c8e5b47-7fea-42c9-9990-ad1f651954b9 service nova] Creating event network-vif-deleted:7aa28d27-c593-4d1f-bd76-5d3dccb52b3c for instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 on hv-cinder-78477 Apr 08 12:23:36.526400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-c37373ca-7c33-4e6d-a8cf-28542e0ed257 req-4c8e5b47-7fea-42c9-9990-ad1f651954b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044390 Apr 08 12:23:36.527139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 501/959] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:23:36.738500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:36.747584 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-89901bb0-01ed-42ad-a2b8-7ab96938b2cd tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1219 microversion: 2.1 time: 0.247681 Apr 08 12:23:36.748210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 459/960] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:36 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1219 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:36.834539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:36.835626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:36.845696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:36.846400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:36.847387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:36.848263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:37.055737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:37.066412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2998846b-428a-4637-9b83-1b9ba8373c76 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.236467 Apr 08 12:23:37.067059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 502/961] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:36 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:37.772511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:37.773194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:37.783497 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:37.784030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:37.784896 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:37.785398 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:37.861375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:37.861889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:37.862437 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lazy-loading 'fault' on Instance uuid a6deb0bf-27c9-49e9-b44b-7871e994fb76 {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:23:37.926983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7678801cc44322b9ac950e68ee5cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89c54d8444949e0a136701bbc6c6577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:37.935073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-dc868d2f-4463-4a2a-a64b-ecc8b0105b87 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 200 len: 1178 microversion: 2.1 time: 0.166699 Apr 08 12:23:37.935693 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 460/962] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:37 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 1178 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:38.084651 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:38.085640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:38.094260 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:38.094811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:38.095776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:38.096277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:38.296575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:38.305551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-350fbd48-aea1-48cc-82a9-e1888140ec79 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.225165 Apr 08 12:23:38.306186 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 503/963] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:38 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:38.953819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:38.954534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] [instance: a6deb0bf-27c9-49e9-b44b-7871e994fb76] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:38.962313 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:38.962865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:38.966977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:38.966977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:39.017079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] HTTP exception thrown: Instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 could not be found. Apr 08 12:23:39.017760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Returning 404 to user: Instance a6deb0bf-27c9-49e9-b44b-7871e994fb76 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:23:39.018699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8d1401ab-fe6f-47bb-999f-7299d5019247 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76" status: 404 len: 111 microversion: 2.1 time: 0.069460 Apr 08 12:23:39.019309 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 461/964] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:38 2021] GET /compute/v2.1/servers/a6deb0bf-27c9-49e9-b44b-7871e994fb76 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:23:39.324119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:39.324790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:39.333730 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:39.334239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:39.335108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:39.335599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:39.397388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-945ddb3b-9347-4dd8-adb4-d93c1c87b7a7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] Calling method '.version_select at 0x7f22588188c8>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:39.449597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-945ddb3b-9347-4dd8-adb4-d93c1c87b7a7 tempest-TestShelveInstance-899333605 tempest-TestShelveInstance-899333605-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-366820502" status: 202 len: 0 microversion: 2.1 time: 0.060044 Apr 08 12:23:39.450529 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 462/965] 10.222.0.43 () {58 vars in 1241 bytes} [Thu Apr 8 12:23:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-366820502 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:23:39.556290 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:39.566346 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-71773586-cf05-4694-8c73-19fd737a18bc tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.246082 Apr 08 12:23:39.567005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 504/966] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:39 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:40.584525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:40.585214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:40.593954 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:40.594506 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:40.595412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:40.595917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:41.135929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:41.145552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f6561abe-1dff-4aba-a68f-a1fe9dc9ee4a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.565018 Apr 08 12:23:41.146124 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 463/967] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:40 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:42.164504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:42.165185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:42.174749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:42.175263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:42.176131 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:42.176622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:42.388776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:42.408767 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b9845702-d001-4342-917b-2b7ffca911bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.248216 Apr 08 12:23:42.409617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 505/968] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:42 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:43.427911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:43.428573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:43.440550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:43.441457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:43.442770 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:43.443486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:43.667764 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:43.677862 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-969f9a0b-deff-46d0-bca8-62df9fc25f9a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.254639 Apr 08 12:23:43.678611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 464/969] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:43 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:43.910491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-516b7ff5-d81c-4c38-b9df-c54ed777d054 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac6abe95-8e61-441e-b7c4-29822463f37e", "device": "/dev/sdb"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:43.912221 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-516b7ff5-d81c-4c38-b9df-c54ed777d054 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:43.920848 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-516b7ff5-d81c-4c38-b9df-c54ed777d054 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:43.921333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-516b7ff5-d81c-4c38-b9df-c54ed777d054 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:43.922592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-516b7ff5-d81c-4c38-b9df-c54ed777d054 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:43.923097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-516b7ff5-d81c-4c38-b9df-c54ed777d054 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:44.550982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-516b7ff5-d81c-4c38-b9df-c54ed777d054 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "POST /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644368 Apr 08 12:23:44.553561 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 506/970] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:23:43 2021] POST /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:23:44.707565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:44.708590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:44.716851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:44.717412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:44.718330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:44.718891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:44.923254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:44.933946 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c75ea989-ac37-4d1c-a10c-58401a24acbb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.230338 Apr 08 12:23:44.934616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 465/971] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:44 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:45.954178 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:45.955292 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:45.964289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:45.964903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:45.965742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:45.966463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:46.421155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:46.430981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ab001c25-e346-49d6-bb95-d025f64181be tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.482550 Apr 08 12:23:46.442363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 507/972] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:45 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:47.450108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:47.450736 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:47.459996 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:47.460522 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:47.461400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:47.461907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:47.669236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:47.679152 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-efebb7f4-a935-4323-90fa-fe6047fe05bd tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.233271 Apr 08 12:23:47.679830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 466/973] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:47 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:48.366844 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-9c8f2817-7da2-42d9-b1f0-6955fdb837b4 req-8d34578b-54f0-4201-ab67-d10cecb07f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375ccd7f-c302-4444-85aa-7b4ab2af3a6e", "name": "network-vif-plugged", "status": "completed", "tag": "0d964002-0b3f-40c6-a636-560a76b20e7d"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:48.368550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:23:48.368550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:23:48.378588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9c8f2817-7da2-42d9-b1f0-6955fdb837b4 req-8d34578b-54f0-4201-ab67-d10cecb07f6a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:48.379110 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9c8f2817-7da2-42d9-b1f0-6955fdb837b4 req-8d34578b-54f0-4201-ab67-d10cecb07f6a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:48.398805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-9c8f2817-7da2-42d9-b1f0-6955fdb837b4 req-8d34578b-54f0-4201-ab67-d10cecb07f6a service nova] Creating event network-vif-plugged:0d964002-0b3f-40c6-a636-560a76b20e7d for instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e on hv-cinder-78477 Apr 08 12:23:48.406569 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-9c8f2817-7da2-42d9-b1f0-6955fdb837b4 req-8d34578b-54f0-4201-ab67-d10cecb07f6a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043442 Apr 08 12:23:48.407518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 508/974] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:23:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:23:48.697305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:48.697986 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:48.706717 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:48.707236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:48.708097 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:48.708599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:48.911568 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:48.920505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d75138d2-d287-4457-95bf-c132c42a1f61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1266 microversion: 2.1 time: 0.227433 Apr 08 12:23:48.921139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 467/975] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:48 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:49.939494 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:49.940276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:49.948472 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:49.948992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:49.949836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:49.950345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:50.579334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:50.588513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d7d4d233-df9f-401c-8761-e5985001602a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1452 microversion: 2.1 time: 0.653791 Apr 08 12:23:50.589366 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 509/976] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:49 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1452 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:50.606692 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:23:50.607393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:23:50.629118 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:50.629783 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:50.630756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:50.631338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:51.056343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:23:51.066209 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b7ce680e-8f0e-485e-b23f-58bb2d5204bf tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1452 microversion: 2.1 time: 0.463593 Apr 08 12:23:51.067092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 468/977] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:23:50 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1452 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:23:54.578363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-692d8e34-666d-447e-821c-81e085c32d73 req-61ffeab6-4d1f-4b45-918f-b4f67388b44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375ccd7f-c302-4444-85aa-7b4ab2af3a6e", "tag": "0d964002-0b3f-40c6-a636-560a76b20e7d"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:23:54.580095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:23:54.580095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:23:54.590417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-692d8e34-666d-447e-821c-81e085c32d73 req-61ffeab6-4d1f-4b45-918f-b4f67388b44c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:23:54.590904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-692d8e34-666d-447e-821c-81e085c32d73 req-61ffeab6-4d1f-4b45-918f-b4f67388b44c service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:23:54.758752 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-692d8e34-666d-447e-821c-81e085c32d73 req-61ffeab6-4d1f-4b45-918f-b4f67388b44c service nova] Creating event network-changed:0d964002-0b3f-40c6-a636-560a76b20e7d for instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e on hv-cinder-78477 Apr 08 12:23:54.764573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-692d8e34-666d-447e-821c-81e085c32d73 req-61ffeab6-4d1f-4b45-918f-b4f67388b44c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190655 Apr 08 12:23:54.765475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 510/978] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:23:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:24:09.833677 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:09.834210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:09.842047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:09.842615 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:09.843594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:09.844093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:10.020415 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lazy-loading 'services' on Instance uuid 7a4994f9-95be-4a29-8b20-985d875fd0e5 {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:24:10.242503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d3fb5130-2d0d-4c3b-af0e-b2026cf2e7db tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5/os-volume_attachments/ac6abe95-8e61-441e-b7c4-29822463f37e" status: 202 len: 0 microversion: 2.1 time: 0.412523 Apr 08 12:24:10.243146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 469/979] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:24:09 2021] DELETE /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5/os-volume_attachments/ac6abe95-8e61-441e-b7c4-29822463f37e => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:24:11.459741 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:11.460427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:11.468616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:11.470880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:11.470880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:11.470880 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:11.534147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:24:11.728361 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-93f52f50-10eb-42ff-859c-81033a531d3e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 204 len: 0 microversion: 2.1 time: 0.273272 Apr 08 12:24:11.729005 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 511/980] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:24:11 2021] DELETE /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:24:11.738841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:11.739622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:11.747904 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:11.748444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:11.749797 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:11.750296 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:11.951102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:11.961019 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f9e51c81-f20f-4b02-820f-55fe87d508bc tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1512 microversion: 2.1 time: 0.227060 Apr 08 12:24:11.961649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 470/981] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:11 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:12.980288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:12.981054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:12.989185 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:12.989667 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:12.990535 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:12.991024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:13.190167 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:13.198961 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d2f13345-dbc2-45e6-b48a-b46abec62d77 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1512 microversion: 2.1 time: 0.223250 Apr 08 12:24:13.199572 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 512/982] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:12 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:14.217636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:14.218383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:14.226558 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:14.239140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:14.239140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:14.239140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:14.688517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:14.698448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d8b8f2b2-066d-40c1-99d9-571d4922242d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 200 len: 1470 microversion: 2.1 time: 0.484847 Apr 08 12:24:14.699101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 471/983] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:14 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:14.846098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-add37f28-bc05-471e-baf7-4a0fb25340ab req-8c3daec4-2941-46f9-b294-dbad30eeba0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4994f9-95be-4a29-8b20-985d875fd0e5", "name": "network-vif-deleted", "tag": "04461e90-6760-4454-b40f-bf4782edc612"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:24:14.848050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:24:14.848050 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:24:14.857125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-add37f28-bc05-471e-baf7-4a0fb25340ab req-8c3daec4-2941-46f9-b294-dbad30eeba0a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:14.857629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-add37f28-bc05-471e-baf7-4a0fb25340ab req-8c3daec4-2941-46f9-b294-dbad30eeba0a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:14.875476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-add37f28-bc05-471e-baf7-4a0fb25340ab req-8c3daec4-2941-46f9-b294-dbad30eeba0a service nova] Creating event network-vif-deleted:04461e90-6760-4454-b40f-bf4782edc612 for instance 7a4994f9-95be-4a29-8b20-985d875fd0e5 on hv-cinder-78477 Apr 08 12:24:14.880891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-add37f28-bc05-471e-baf7-4a0fb25340ab req-8c3daec4-2941-46f9-b294-dbad30eeba0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038925 Apr 08 12:24:14.881524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 513/984] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:24:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:24:15.717507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:15.718910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 7a4994f9-95be-4a29-8b20-985d875fd0e5] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:15.726719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:15.727229 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:15.728059 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:15.728553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:15.781273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] HTTP exception thrown: Instance 7a4994f9-95be-4a29-8b20-985d875fd0e5 could not be found. Apr 08 12:24:15.781919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Returning 404 to user: Instance 7a4994f9-95be-4a29-8b20-985d875fd0e5 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:24:15.782836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-78837ea0-9221-46e9-b1fc-fff83618c18e tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5" status: 404 len: 111 microversion: 2.1 time: 0.069563 Apr 08 12:24:15.783431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 472/985] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:15 2021] GET /compute/v2.1/servers/7a4994f9-95be-4a29-8b20-985d875fd0e5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:24:26.476334 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2040830867", "imageRef": "7097cc90-8e66-4015-90e4-fa2d90029954", "flavorRef": "452", "networks": [{"uuid": "090d0cca-d772-4818-b41a-7784a21aa522"}]}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:24:26.758341 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] validate_networks() for [('090d0cca-d772-4818-b41a-7784a21aa522', None, None, None)] {{(pid=98473) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:24:27.298945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Flavor limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:24:27.299422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Image limits 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:24:27.299968 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Flavor pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:24:27.300479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Image pref 0:0:0 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:24:27.300962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:24:27.309887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:27.310424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:27.311304 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:27.311800 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:27.330446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Getting quotas for project 77de47205a4543c1992a0e5acc27ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:24:27.335286 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Getting quotas for user 3c5acdf20a3c498f85baed149717c07b and project 77de47205a4543c1992a0e5acc27ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:24:27.346401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Going to run 1 instances... {{(pid=98473) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:24:27.349143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7097cc90-8e66-4015-90e4-fa2d90029954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:24:27.459298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3c909950-74af-43ff-8d0d-a9e50414ea0a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987929 Apr 08 12:24:27.460004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 514/986] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:24:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:24:27.470719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-15a96c72-198c-4218-8172-533fae611304 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:27.471404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-15a96c72-198c-4218-8172-533fae611304 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:27.713661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-15a96c72-198c-4218-8172-533fae611304 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:27.721798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-15a96c72-198c-4218-8172-533fae611304 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1219 microversion: 2.1 time: 0.255142 Apr 08 12:24:27.722433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 473/987] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:27 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1219 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:24:28.740233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:28.740906 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:28.749202 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:28.749716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:28.750582 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:28.751079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:28.877781 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:28.887193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b4de5433-53da-48f4-a0b9-b6e38af06c2a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1271 microversion: 2.1 time: 0.151087 Apr 08 12:24:28.887810 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 515/988] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:28 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:29.906197 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:29.906927 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:29.916014 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:29.916531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:29.917401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:29.917907 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:30.226850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:30.236035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1e26a10d-6a83-4d91-b140-f18a4ebfed13 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.333940 Apr 08 12:24:30.236659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 474/989] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:29 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:31.255649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:31.256206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:31.263900 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:31.264418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:31.265257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:31.265756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:31.472855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:31.481953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3eecfad8-4284-47c9-a0f8-784c5ff27f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.231570 Apr 08 12:24:31.482697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 516/990] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:31 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:31.616213 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d258f41b-37e1-4a70-8fa3-cc345734fc0c req-df326a61-b3ac-461d-a85a-61a303fd8772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232ba907-3ad2-40b8-90c6-55d5251aa91a", "tag": "39eece46-43e7-4706-b119-107bf37931c1"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:24:31.618051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:24:31.618051 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:24:31.627223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d258f41b-37e1-4a70-8fa3-cc345734fc0c req-df326a61-b3ac-461d-a85a-61a303fd8772 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:31.634579 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d258f41b-37e1-4a70-8fa3-cc345734fc0c req-df326a61-b3ac-461d-a85a-61a303fd8772 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:31.645533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d258f41b-37e1-4a70-8fa3-cc345734fc0c req-df326a61-b3ac-461d-a85a-61a303fd8772 service nova] Creating event network-changed:39eece46-43e7-4706-b119-107bf37931c1 for instance 232ba907-3ad2-40b8-90c6-55d5251aa91a on hv-cinder-78477 Apr 08 12:24:31.650557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d258f41b-37e1-4a70-8fa3-cc345734fc0c req-df326a61-b3ac-461d-a85a-61a303fd8772 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038919 Apr 08 12:24:31.651242 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 475/991] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:24:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:24:32.511697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:32.512405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:32.520401 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:32.520918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:32.521763 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:32.522261 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:32.715123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:32.724465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3bd089b3-122d-40b7-a8ec-6aa37475a459 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.216752 Apr 08 12:24:32.725030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 517/992] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:32 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:24:33.743430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:33.744128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:33.752507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:33.753017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:33.753849 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:33.754362 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:34.038177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:34.047183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-69dd6061-f8ec-49ee-a9f0-111985a2c178 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.308918 Apr 08 12:24:34.047815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 476/993] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:33 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:35.065870 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:35.066574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:35.074910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:35.075433 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:35.076312 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:35.076816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:35.276680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:35.285434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0e0a355c-4faa-4f18-b0cd-83f039a31638 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.223670 Apr 08 12:24:35.286978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 518/994] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:35 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:36.305349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:36.306024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:36.313975 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:36.314544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:36.315381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:36.315874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:36.509311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:36.518267 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-138adbcf-4e62-4c40-baa0-5d01dd9c04a3 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.218001 Apr 08 12:24:36.518932 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 477/995] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:36 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:37.536173 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:37.536839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:37.545111 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:37.545618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:37.546467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:37.546957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:37.743990 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:37.752917 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-21ef442c-9aa9-4f70-ab2d-827b4e5f9ee1 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.220841 Apr 08 12:24:37.753526 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 519/996] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:37 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:38.731003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d67508ec-851d-4b91-b260-c0a25f26b934 req-afab2122-fab6-43a0-86c1-de19e1ca0a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232ba907-3ad2-40b8-90c6-55d5251aa91a", "name": "network-vif-plugged", "status": "completed", "tag": "39eece46-43e7-4706-b119-107bf37931c1"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:24:38.732744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:24:38.732744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:24:38.741513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d67508ec-851d-4b91-b260-c0a25f26b934 req-afab2122-fab6-43a0-86c1-de19e1ca0a5a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:38.745371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d67508ec-851d-4b91-b260-c0a25f26b934 req-afab2122-fab6-43a0-86c1-de19e1ca0a5a service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:38.760192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d67508ec-851d-4b91-b260-c0a25f26b934 req-afab2122-fab6-43a0-86c1-de19e1ca0a5a service nova] Creating event network-vif-plugged:39eece46-43e7-4706-b119-107bf37931c1 for instance 232ba907-3ad2-40b8-90c6-55d5251aa91a on hv-cinder-78477 Apr 08 12:24:38.765220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d67508ec-851d-4b91-b260-c0a25f26b934 req-afab2122-fab6-43a0-86c1-de19e1ca0a5a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038360 Apr 08 12:24:38.766024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 478/997] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:24:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:24:38.772117 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:38.772811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:38.782006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:38.782554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:38.783395 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:38.783887 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:38.985412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:38.995170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3dcc7e74-2879-40bf-8af6-0ac4fd6a5c01 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1319 microversion: 2.1 time: 0.227215 Apr 08 12:24:38.995796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 520/998] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:38 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:40.014166 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:24:40.014967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:40.023114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:40.023634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:40.024483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:40.024983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:40.221596 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:24:40.231109 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6e38f67b-8da7-4d1c-9235-7738b0c1eeba tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1507 microversion: 2.1 time: 0.220890 Apr 08 12:24:40.231744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 479/999] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:24:40 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:24:40.248729 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8354bbdd-d120-415d-ab73-88acf0e407ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97b40a39-339c-42b4-bf1f-bedb0ae51218", "device": "/dev/sdb"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:24:40.250093 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8354bbdd-d120-415d-ab73-88acf0e407ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:24:40.258222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8354bbdd-d120-415d-ab73-88acf0e407ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:40.258771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8354bbdd-d120-415d-ab73-88acf0e407ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:40.259619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8354bbdd-d120-415d-ab73-88acf0e407ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:24:40.260114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8354bbdd-d120-415d-ab73-88acf0e407ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:24:40.851536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8354bbdd-d120-415d-ab73-88acf0e407ee tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "POST /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606825 Apr 08 12:24:40.852130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 521/1000] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:24:40 2021] POST /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a/os-volume_attachments => generated 194 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:25:01.351850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:01.352440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:01.360524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:01.361045 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:01.362082 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:01.362638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:01.538092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lazy-loading 'services' on Instance uuid 232ba907-3ad2-40b8-90c6-55d5251aa91a {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:25:01.744204 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bcb7ebfe-0c46-476b-99f8-0df1b67d3f5d tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "DELETE /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a/os-volume_attachments/97b40a39-339c-42b4-bf1f-bedb0ae51218" status: 202 len: 0 microversion: 2.1 time: 0.396520 Apr 08 12:25:01.744882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 480/1001] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:25:01 2021] DELETE /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a/os-volume_attachments/97b40a39-339c-42b4-bf1f-bedb0ae51218 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:25:02.956029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:02.956688 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:02.965563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:02.966080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:02.966982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:02.967503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:03.031682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:25:03.235865 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a7f030c0-df1d-48fe-9481-93f75982da1a tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "DELETE /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 204 len: 0 microversion: 2.1 time: 0.284561 Apr 08 12:25:03.236440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 522/1002] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:25:02 2021] DELETE /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:25:03.250022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:03.250817 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:03.261258 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:03.261814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:03.262690 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:03.263187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:03.464467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:25:03.473489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d285ea5d-e6e1-4299-8487-63f85b8021dd tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1513 microversion: 2.1 time: 0.227788 Apr 08 12:25:03.474112 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 481/1003] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:03 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:25:04.493491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:04.494206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:04.502033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:04.502828 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:04.503678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:04.504277 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:04.698108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:25:04.707041 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0c3e398d-c96f-4897-bd9d-ad055127600b tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1513 microversion: 2.1 time: 0.218673 Apr 08 12:25:04.707654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 523/1004] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:04 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:25:05.725491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:05.726165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:05.734026 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:05.734570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:05.735407 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:05.735903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:05.869001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-ac08f7a9-2e5c-4150-b787-1cc7b676ebe5 req-5f7d6ae8-bca1-4f4a-bad6-f996e3118aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232ba907-3ad2-40b8-90c6-55d5251aa91a", "name": "network-vif-deleted", "tag": "39eece46-43e7-4706-b119-107bf37931c1"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:25:05.871604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:25:05.871604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:25:05.880599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ac08f7a9-2e5c-4150-b787-1cc7b676ebe5 req-5f7d6ae8-bca1-4f4a-bad6-f996e3118aba service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:05.881096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ac08f7a9-2e5c-4150-b787-1cc7b676ebe5 req-5f7d6ae8-bca1-4f4a-bad6-f996e3118aba service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:05.898474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-ac08f7a9-2e5c-4150-b787-1cc7b676ebe5 req-5f7d6ae8-bca1-4f4a-bad6-f996e3118aba service nova] Creating event network-vif-deleted:39eece46-43e7-4706-b119-107bf37931c1 for instance 232ba907-3ad2-40b8-90c6-55d5251aa91a on hv-cinder-78477 Apr 08 12:25:05.903510 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-ac08f7a9-2e5c-4150-b787-1cc7b676ebe5 req-5f7d6ae8-bca1-4f4a-bad6-f996e3118aba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098970 Apr 08 12:25:05.904151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 524/1005] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:25:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:25:05.924208 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c5acdf20a3c498f85baed149717c07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77de47205a4543c1992a0e5acc27ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:25:05.934010 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6aa2f567-1b88-4bf7-aad0-c2267a269b71 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 200 len: 1471 microversion: 2.1 time: 0.212818 Apr 08 12:25:05.934660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 482/1006] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:05 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:25:06.953699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:06.954500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] [instance: 232ba907-3ad2-40b8-90c6-55d5251aa91a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:06.963302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:06.963818 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:06.964661 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:06.965157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:07.017075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] HTTP exception thrown: Instance 232ba907-3ad2-40b8-90c6-55d5251aa91a could not be found. Apr 08 12:25:07.017728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] Returning 404 to user: Instance 232ba907-3ad2-40b8-90c6-55d5251aa91a could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:25:07.018639 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8f5ace23-ce1f-47b7-a1c4-d7dd83444799 tempest-VolumesSnapshotTestJSON-382893331 tempest-VolumesSnapshotTestJSON-382893331-project] 10.222.0.43 "GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a" status: 404 len: 111 microversion: 2.1 time: 0.069502 Apr 08 12:25:07.019897 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 525/1007] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:06 2021] GET /compute/v2.1/servers/232ba907-3ad2-40b8-90c6-55d5251aa91a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:25:54.187834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:54.188552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:54.197389 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:54.197910 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:54.198871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:54.199374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:54.266244 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Going to try to terminate instance {{(pid=98474) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:25:54.504496 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-88861ad7-aefd-45d5-9dde-2c9cf3b43e32 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 204 len: 0 microversion: 2.1 time: 0.320299 Apr 08 12:25:54.505103 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 483/1008] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:25:54 2021] DELETE /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:25:54.516043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:54.516723 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:54.530671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:54.531675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:54.532898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:54.533541 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:54.842492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:25:54.851680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0809160d-9c0b-4017-9a3c-2ef94f487c30 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1576 microversion: 2.1 time: 0.339616 Apr 08 12:25:54.852288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 526/1009] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:54 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1576 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:25:55.872126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:55.873033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:55.883380 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:55.886544 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:55.887774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:55.888278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:56.241814 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:25:56.252460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c1d60571-bb2b-461a-b284-b505a7258510 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1576 microversion: 2.1 time: 0.386184 Apr 08 12:25:56.253597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 484/1010] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:55 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1576 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:25:57.273336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:57.273995 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:57.285055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:57.285867 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:57.287552 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:57.288179 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:57.438590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:25:57.451325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4c89f111-0002-476b-8002-4a300761fdd4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1509 microversion: 2.1 time: 0.183475 Apr 08 12:25:57.452066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 527/1011] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:57 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:25:58.303650 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-0581a2f3-817a-4041-93b2-511a791613b2 req-a2ef1379-1f37-43e0-8b5d-d0181fe4deea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375ccd7f-c302-4444-85aa-7b4ab2af3a6e", "name": "network-vif-deleted", "tag": "0d964002-0b3f-40c6-a636-560a76b20e7d"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:25:58.306187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:25:58.306187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:25:58.369500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-0581a2f3-817a-4041-93b2-511a791613b2 req-a2ef1379-1f37-43e0-8b5d-d0181fe4deea service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:58.370092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-0581a2f3-817a-4041-93b2-511a791613b2 req-a2ef1379-1f37-43e0-8b5d-d0181fe4deea service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:58.472441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:58.473657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:58.480715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-0581a2f3-817a-4041-93b2-511a791613b2 req-a2ef1379-1f37-43e0-8b5d-d0181fe4deea service nova] Creating event network-vif-deleted:0d964002-0b3f-40c6-a636-560a76b20e7d for instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e on hv-cinder-78477 Apr 08 12:25:58.484687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:58.486195 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:58.487485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:58.488143 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:58.490470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-0581a2f3-817a-4041-93b2-511a791613b2 req-a2ef1379-1f37-43e0-8b5d-d0181fe4deea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198702 Apr 08 12:25:58.491381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 485/1012] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:25:58.651637 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:25:58.663287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cff4387b-ec05-4864-9cc6-9245ff6dad56 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1226 microversion: 2.1 time: 0.195434 Apr 08 12:25:58.664243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 528/1013] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:58 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1226 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:25:59.682288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:25:59.683238 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:25:59.710874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:59.713708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:59.713708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:59.713708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:59.916279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:25:59.916798 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:25:59.917317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lazy-loading 'fault' on Instance uuid 375ccd7f-c302-4444-85aa-7b4ab2af3a6e {{(pid=98474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:26:00.107708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:00.122738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ad83a91c-5c96-4dae-a1ae-723265f1e3b7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 200 len: 1185 microversion: 2.1 time: 0.445651 Apr 08 12:26:00.130822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 486/1014] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:25:59 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 1185 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:01.141846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:01.142786 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:01.151988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:01.152592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:01.153617 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:01.154192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:01.210659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] HTTP exception thrown: Instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e could not be found. Apr 08 12:26:01.210659 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Returning 404 to user: Instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:26:01.213133 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c3448965-0879-4acf-aa03-0f3183bd8c9e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 404 len: 111 microversion: 2.1 time: 0.075834 Apr 08 12:26:01.213773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 529/1015] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:01 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:26:01.369869 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1528225189", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1775416410", "security_groups": [{"name": "tempest-secgroup-smoke-332410541"}], "block_device_mapping_v2": [{"uuid": "6d2430a3-f912-4221-bf83-ca7384a503e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f160ec1-7ce7-4365-ac22-b0d5421f97ed"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:01.556873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] validate_networks() for [('7f160ec1-7ce7-4365-ac22-b0d5421f97ed', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:26:02.261516 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:26:02.262139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:26:02.262563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:26:02.263036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:26:02.263505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:26:02.285065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:02.287448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:02.288225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:02.288742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:02.342402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for project 5174f889b4cf4def811b78439275f602. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:26:02.346608 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for user 50b370fd6c2b4462a4199830f771ea1c and project 5174f889b4cf4def811b78439275f602. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:26:02.477141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:26:02.479649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d2430a3-f912-4221-bf83-ca7384a503e0',volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:26:02.900780 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e6bf6e04-83f8-4a32-a975-e97927011aa8 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.534918 Apr 08 12:26:02.905724 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 487/1016] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:26:01 2021] POST /compute/v2.1/servers => generated 405 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:26:02.924977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ecf96feb-e1a0-458f-8c0d-9415843a622f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:02.927834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ecf96feb-e1a0-458f-8c0d-9415843a622f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:03.090748 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ecf96feb-e1a0-458f-8c0d-9415843a622f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:03.099114 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ecf96feb-e1a0-458f-8c0d-9415843a622f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1095 microversion: 2.1 time: 0.186922 Apr 08 12:26:03.100384 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 530/1017] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:02 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1095 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:04.119542 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:04.120832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:04.135536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:04.136630 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:04.137683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:04.138387 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:04.294519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:04.307318 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e573b181-bf2f-42d3-a398-af099d3a9f24 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1137 microversion: 2.1 time: 0.193317 Apr 08 12:26:04.315855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 488/1018] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:04 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1137 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:05.326257 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:05.327040 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:05.452822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:05.452822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:05.452822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:05.452822 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:05.462328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:05.471461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-594697c0-74da-4597-8078-5c5b4fe19769 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1201 microversion: 2.1 time: 0.149336 Apr 08 12:26:05.472092 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 531/1019] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:05 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1201 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:06.490163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:06.491047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:06.498999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:06.499515 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:06.500442 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:06.500945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:06.670703 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:06.680963 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e56e1fc0-1c2e-4d75-9d10-d41bf40d15e3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1201 microversion: 2.1 time: 0.195398 Apr 08 12:26:06.682058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 489/1020] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:06 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1201 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:06.832577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e2803378-df3f-4e21-a44d-8c15d613bae3 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Action: 'create', calling method: .version_select at 0x7f22587a9bf8>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-533517611"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:06.858951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-e2803378-df3f-4e21-a44d-8c15d613bae3 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Getting quotas for project 3c8d280858a84a1fa6535c7bdf155095. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:26:06.865268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-e2803378-df3f-4e21-a44d-8c15d613bae3 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Getting quotas for user a0fc126aa68f496098e6013c4d804489 and project 3c8d280858a84a1fa6535c7bdf155095. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:26:07.236594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-e2803378-df3f-4e21-a44d-8c15d613bae3 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Getting quotas for project 3c8d280858a84a1fa6535c7bdf155095. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:26:07.241090 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-e2803378-df3f-4e21-a44d-8c15d613bae3 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Getting quotas for user a0fc126aa68f496098e6013c4d804489 and project 3c8d280858a84a1fa6535c7bdf155095. Resources: {'key_pairs'} {{(pid=98473) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:26:07.254759 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e2803378-df3f-4e21-a44d-8c15d613bae3 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.426224 Apr 08 12:26:07.257489 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 532/1021] 10.222.0.43 () {60 vars in 1148 bytes} [Thu Apr 8 12:26:06 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:07.312003 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-375338248", "imageRef": "1f4a33be-8c1a-4cf4-8fba-102146fcdaca", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-533517611", "networks": [{"uuid": "4d0f2def-993d-407d-b9ff-9bae1274942d"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:07.386086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] validate_networks() for [('4d0f2def-993d-407d-b9ff-9bae1274942d', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:26:07.699463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:07.700235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:07.709165 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:07.709678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:07.710575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:07.711068 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:07.930043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:07.939067 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b56fb06a-7a71-4028-8a85-750643fd8eea tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1278 microversion: 2.1 time: 0.243701 Apr 08 12:26:07.939697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 533/1022] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:07 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:08.809214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:26:08.809775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:26:08.810364 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:26:08.810831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:26:08.811301 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:26:08.820519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:08.821035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:08.821925 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:08.822460 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:08.842353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Getting quotas for project 3c8d280858a84a1fa6535c7bdf155095. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:26:08.846493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Getting quotas for user a0fc126aa68f496098e6013c4d804489 and project 3c8d280858a84a1fa6535c7bdf155095. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:26:08.858438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:26:08.860871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f4a33be-8c1a-4cf4-8fba-102146fcdaca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:26:08.956676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:08.957417 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:08.977971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:08.978578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:08.979450 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:08.979952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:08.999042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1cef64fc-f007-452e-bee2-7611f276d278 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.691008 Apr 08 12:26:08.999744 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 490/1023] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:26:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:26:09.011096 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a6c2bd73-491a-40c9-b00c-fd662d8c3e2f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:09.012032 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a6c2bd73-491a-40c9-b00c-fd662d8c3e2f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:09.139322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a6c2bd73-491a-40c9-b00c-fd662d8c3e2f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:09.150482 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a6c2bd73-491a-40c9-b00c-fd662d8c3e2f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1257 microversion: 2.1 time: 0.143356 Apr 08 12:26:09.151707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 491/1024] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:09 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1257 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:09.209750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:09.219644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-51fc1d7c-a498-4a84-8b7c-ca93205536b6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.267227 Apr 08 12:26:09.220396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 534/1025] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:08 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:09.529295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-758ba08a-1551-48ad-874b-85cf53b5dbb4 req-904db734-adc4-48d0-b0ad-4b046e8607f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d764c2-4fed-4f43-a1f2-822807c71de8", "tag": "fa87f37f-3b47-4e81-b0b3-efa22949c247"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:09.531958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:09.531958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:09.536278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Traceback (most recent call last): Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: timer() Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: File "/usr/local/lib/python3.6/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: cb(*args, **kw) Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: File "/usr/local/lib/python3.6/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: waiter.switch() Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: greenlet.error: cannot switch to a different thread Apr 08 12:26:09.542363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-758ba08a-1551-48ad-874b-85cf53b5dbb4 req-904db734-adc4-48d0-b0ad-4b046e8607f8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:09.543113 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-758ba08a-1551-48ad-874b-85cf53b5dbb4 req-904db734-adc4-48d0-b0ad-4b046e8607f8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:09.572762 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-758ba08a-1551-48ad-874b-85cf53b5dbb4 req-904db734-adc4-48d0-b0ad-4b046e8607f8 service nova] Creating event network-changed:fa87f37f-3b47-4e81-b0b3-efa22949c247 for instance 40d764c2-4fed-4f43-a1f2-822807c71de8 on hv-cinder-78477 Apr 08 12:26:09.579834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-758ba08a-1551-48ad-874b-85cf53b5dbb4 req-904db734-adc4-48d0-b0ad-4b046e8607f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054771 Apr 08 12:26:09.580502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 492/1026] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:26:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:10.169934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:10.170564 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:10.180641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:10.181578 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:10.182457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:10.182955 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:10.240360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:10.241227 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:10.249365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:10.249885 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:10.250755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:10.251249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:10.308604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:10.319210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-17dcc550-1188-45d4-84c9-6f737aa5823f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1253 microversion: 2.1 time: 0.153799 Apr 08 12:26:10.320230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 535/1027] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:10 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1253 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:10.638155 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:10.647192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-774d710d-969b-4d27-bb96-6ee491488f04 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.411944 Apr 08 12:26:10.647824 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 493/1028] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:10 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:26:11.337889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:11.338597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:11.346626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:11.347118 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:11.347953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:11.348446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:11.484898 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:11.494823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-df70ae1a-1c68-4b84-8ff3-1d0a22e4a075 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1315 microversion: 2.1 time: 0.161436 Apr 08 12:26:11.495439 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 536/1029] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:11 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:11.665331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:11.666138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:11.674379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:11.674918 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:11.675787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:11.676293 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:11.879363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:11.890001 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c39d53bc-49ed-4478-9879-c5648342a2a7 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.228832 Apr 08 12:26:11.900585 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 494/1030] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:11 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:12.513476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:12.514136 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:12.532220 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:12.532735 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:12.533586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:12.534077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:12.839218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:12.853030 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c67976bb-66da-4384-bb16-4d8488df2a6b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.343620 Apr 08 12:26:12.854053 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 537/1031] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:12 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:12.908098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:12.909047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:12.917958 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:12.918945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:12.920305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:12.921063 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:13.064953 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cdf2619a-498f-4d04-86a4-e49920cb373d] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 12:26:13.133302 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:13.142711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a01c9687-04f0-483f-a5f3-76230db4633f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.238804 Apr 08 12:26:13.143556 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 495/1032] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:12 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:13.871211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:13.871881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:13.880638 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:13.881146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:13.881999 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:13.882551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:14.089654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:14.099263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-22a6deb7-5f04-4606-8ffc-4ba3998d59d6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.231520 Apr 08 12:26:14.099891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 538/1033] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:13 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:14.161605 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:14.162271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:14.180965 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:14.181458 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:14.182527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:14.183170 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:14.244755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] [cdf2619a-498f-4d04-86a4-e49920cb373d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54508. Apr 08 12:26:14.393481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:14.406253 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-30cba32d-4400-40f6-a96a-e91451c87340 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.248667 Apr 08 12:26:14.407670 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 496/1034] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:14 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:15.118214 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:15.119047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:15.127193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:15.127789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:15.128971 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:15.129540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:15.334410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:15.343210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a83636da-ab90-4caa-bf87-f26096cd1c42 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.230119 Apr 08 12:26:15.343830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 539/1035] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:15 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:15.425200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:15.425796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:15.434837 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:15.435351 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:15.436239 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:15.436739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:15.646743 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:15.657647 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3aaee64c-9132-4cee-ba4f-2a043effd622 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.236463 Apr 08 12:26:15.658577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 497/1036] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:15 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:16.362194 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:16.362928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:16.371402 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:16.371919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:16.372931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:16.373430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:16.581753 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:16.592039 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a52b71ec-7603-4874-a554-98c16273fef1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.234440 Apr 08 12:26:16.603453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 540/1037] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:16 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:16.676603 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:16.677431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:16.685878 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:16.686444 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:16.687328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:16.687877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:16.889871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:16.899782 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aaad12fd-f611-429f-80c7-6b9f013a628d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.227310 Apr 08 12:26:16.900586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 498/1038] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:16 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:26:17.619305 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:17.619984 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:17.627962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:17.628728 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:17.629658 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:17.630230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:17.832452 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:17.842427 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f96a762d-6e03-4254-a998-9c5310633701 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.227098 Apr 08 12:26:17.843073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 541/1039] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:17 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:17.918223 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:17.918922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:17.927130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:17.927773 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:17.928637 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:17.929140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:18.151193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:18.160468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9891fc4a-6039-4e99-8bc6-c48d6fec1b6b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.246211 Apr 08 12:26:18.161177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 499/1040] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:17 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:18.860809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:18.861479 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:18.869924 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:18.870468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:18.871330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:18.871830 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:19.075790 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:19.085263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0584c528-6495-47e3-a302-d069cb77071d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.228504 Apr 08 12:26:19.086119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 542/1041] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:18 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:19.179509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:19.180119 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:19.188031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:19.188551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:19.189400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:19.189905 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:19.393270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:19.408228 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d20c16ce-ef9a-4524-a103-f4ed78c62415 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.233347 Apr 08 12:26:19.408888 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 500/1042] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:19 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:20.106062 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:20.106804 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:20.115184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:20.115701 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:20.116554 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:20.117060 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:20.324832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:20.334860 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-42deb04a-04f5-40a2-b98f-ee5e64424a46 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.232804 Apr 08 12:26:20.335487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 543/1043] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:20 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:20.427303 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:20.428184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:20.436683 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:20.437288 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:20.438148 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:20.438694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:20.643443 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:20.654891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-388d4282-5229-4b29-879d-4eab5835b956 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.231890 Apr 08 12:26:20.655534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 501/1044] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:20 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:21.353519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:21.354372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:21.362375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:21.363066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:21.372042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:21.372042 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:21.618891 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:21.630809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9cf75a03-ad04-4c88-8681-c0134aed0b8c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.281076 Apr 08 12:26:21.631706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 544/1045] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:21 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:21.675446 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:21.676226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:21.684733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:21.685250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:21.686094 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:21.686648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:21.934919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:21.934919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3f05999a-2a32-45bc-bb4a-86227ef53ff2 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.235609 Apr 08 12:26:21.934919 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 502/1046] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:21 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:26:22.649619 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:22.650563 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:22.658796 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:22.659413 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:22.660393 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:22.661128 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:22.951054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:22.951739 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:22.959977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:22.960502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:22.961573 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:22.962081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:23.058903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:23.070259 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1e7b56f3-ac1d-4280-af10-1c03c53be170 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.424528 Apr 08 12:26:23.071218 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 545/1047] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:22 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:23.175821 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:23.185285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3e30bc4a-2aaf-4b26-89e7-90f852770833 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.238503 Apr 08 12:26:23.185920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 503/1048] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:22 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:23.480289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d0dd48d4-0f64-4095-809a-58a4e7f3ee1c req-f223c07f-a720-4b77-b803-8fbc4b5fe01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d045c-39b8-4f31-ac53-670d393586ec", "tag": "e1cac246-8b1b-4654-8126-5f3b625326b3"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:23.481978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:23.481978 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:23.491757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d0dd48d4-0f64-4095-809a-58a4e7f3ee1c req-f223c07f-a720-4b77-b803-8fbc4b5fe01e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:23.500610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d0dd48d4-0f64-4095-809a-58a4e7f3ee1c req-f223c07f-a720-4b77-b803-8fbc4b5fe01e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:23.510871 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d0dd48d4-0f64-4095-809a-58a4e7f3ee1c req-f223c07f-a720-4b77-b803-8fbc4b5fe01e service nova] Creating event network-changed:e1cac246-8b1b-4654-8126-5f3b625326b3 for instance 9c5d045c-39b8-4f31-ac53-670d393586ec on hv-cinder-78477 Apr 08 12:26:23.516108 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d0dd48d4-0f64-4095-809a-58a4e7f3ee1c req-f223c07f-a720-4b77-b803-8fbc4b5fe01e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039826 Apr 08 12:26:23.516771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 546/1049] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:26:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:24.089355 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:24.090031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:24.098523 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:24.099043 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:24.099914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:24.100412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:24.204316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:24.205095 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:24.214505 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:24.215022 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:24.216079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:24.216372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:24.315055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:24.325033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2af1e51e-51aa-4bee-a635-4879f0b74000 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.239748 Apr 08 12:26:24.325809 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 504/1050] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:24 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:24.574485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:24.583657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-af032728-9192-42d4-927f-60301a75ef61 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.383923 Apr 08 12:26:24.584295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 547/1051] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:24 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:26:25.343470 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:25.344243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:25.353336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:25.353846 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:25.354711 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:25.355250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:25.560312 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:25.570112 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a3312c2d-226d-43cf-81ff-d7d0f780262c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.230742 Apr 08 12:26:25.570791 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 505/1052] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:25 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:25.601768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:25.602485 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:25.610327 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:25.610847 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:25.611691 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:25.612193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:25.818164 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:25.827322 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a9cfb53a-c72f-4966-af4e-c60faaab657b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.230008 Apr 08 12:26:25.827956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 548/1053] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:25 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:26.588942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:26.597151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:26.597469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:26.598629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:26.599474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:26.599976 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:26.793453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:26.802246 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c1458ad1-f403-4441-8ade-69b01dd5ed53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.217645 Apr 08 12:26:26.802882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 506/1054] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:26 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:26.845539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:26.846285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:26.854859 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:26.855403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:26.856275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:26.856778 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:27.053404 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:27.062675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-733a0a51-d1ec-4766-b84a-942fab8c3124 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.221311 Apr 08 12:26:27.063316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 549/1055] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:26 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:27.608073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-5399f3ac-c7b8-4a76-8908-ce8eb9dfb4a9 req-14875254-1a92-445d-b205-e3cb0c11f0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d764c2-4fed-4f43-a1f2-822807c71de8", "name": "network-vif-plugged", "status": "completed", "tag": "fa87f37f-3b47-4e81-b0b3-efa22949c247"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:27.609967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:27.609967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:27.619760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-5399f3ac-c7b8-4a76-8908-ce8eb9dfb4a9 req-14875254-1a92-445d-b205-e3cb0c11f0a0 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:27.620274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-5399f3ac-c7b8-4a76-8908-ce8eb9dfb4a9 req-14875254-1a92-445d-b205-e3cb0c11f0a0 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:27.638066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-5399f3ac-c7b8-4a76-8908-ce8eb9dfb4a9 req-14875254-1a92-445d-b205-e3cb0c11f0a0 service nova] Creating event network-vif-plugged:fa87f37f-3b47-4e81-b0b3-efa22949c247 for instance 40d764c2-4fed-4f43-a1f2-822807c71de8 on hv-cinder-78477 Apr 08 12:26:27.643381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-5399f3ac-c7b8-4a76-8908-ce8eb9dfb4a9 req-14875254-1a92-445d-b205-e3cb0c11f0a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176185 Apr 08 12:26:27.644079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 507/1056] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:26:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:27.820892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:27.821610 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:27.829761 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:27.830270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:27.831134 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:27.831622 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:28.082018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:28.083626 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:28.091811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:28.092399 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:28.093298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:28.093802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:28.116237 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:28.125333 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ca3315cc-98c1-4f6a-8549-2e6c23ce399c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.309128 Apr 08 12:26:28.126089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 550/1057] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:27 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:28.293055 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:28.303210 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-bc158034-59c7-48aa-8ee3-ee52826e9ffb tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1266 microversion: 2.1 time: 0.225812 Apr 08 12:26:28.303850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 508/1058] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:28 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:29.144232 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:29.144949 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:29.152980 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:29.153491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:29.154353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:29.154858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:29.321374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:29.322423 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:29.330792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:29.331312 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:29.332222 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:29.332707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:29.350190 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:29.359325 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f005d913-54d4-4a0e-95f0-0271e1446bda tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.219229 Apr 08 12:26:29.360156 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 551/1059] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:29 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:29.533631 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:29.543802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-888146d2-77ce-44f3-ba48-e694250ccda5 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1452 microversion: 2.1 time: 0.226467 Apr 08 12:26:29.544476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 509/1060] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:29 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1452 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:29.561276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:29.561945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:29.570139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:29.570646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:29.571475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:29.571969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:29.657699 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-212d348d-b73c-4b6c-b7d2-816640048468 req-5ee332bd-8554-4b88-9506-34c4bc9a35f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5d045c-39b8-4f31-ac53-670d393586ec", "name": "network-vif-plugged", "status": "completed", "tag": "e1cac246-8b1b-4654-8126-5f3b625326b3"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:29.659488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:29.659488 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:29.668624 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-212d348d-b73c-4b6c-b7d2-816640048468 req-5ee332bd-8554-4b88-9506-34c4bc9a35f8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:29.669130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-212d348d-b73c-4b6c-b7d2-816640048468 req-5ee332bd-8554-4b88-9506-34c4bc9a35f8 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:29.687163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-212d348d-b73c-4b6c-b7d2-816640048468 req-5ee332bd-8554-4b88-9506-34c4bc9a35f8 service nova] Creating event network-vif-plugged:e1cac246-8b1b-4654-8126-5f3b625326b3 for instance 9c5d045c-39b8-4f31-ac53-670d393586ec on hv-cinder-78477 Apr 08 12:26:29.692858 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-212d348d-b73c-4b6c-b7d2-816640048468 req-5ee332bd-8554-4b88-9506-34c4bc9a35f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038556 Apr 08 12:26:29.693513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 510/1061] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:26:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:26:29.771377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:29.780271 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d586e0a5-0258-4de8-b82a-b6a782e1ff98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1452 microversion: 2.1 time: 0.222949 Apr 08 12:26:29.780892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 552/1062] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:29 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1452 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:30.378845 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:30.379850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:30.388632 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:30.389149 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:30.390011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:30.390551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:30.593550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:30.603306 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b1af3b0b-f59e-4340-b0ab-7d98d311ce30 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1357 microversion: 2.1 time: 0.229382 Apr 08 12:26:30.603941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 511/1063] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:30 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:31.621774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:31.622476 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:31.630915 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:31.633694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:31.633694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:31.633694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:32.260635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:32.269742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5db8c1a9-f204-4a25-b1c3-6dc40ccbade4 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1547 microversion: 2.1 time: 0.652247 Apr 08 12:26:32.270929 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 553/1064] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:31 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1547 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:32.287649 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:32.288192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:32.296539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:32.296539 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:32.297388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:32.297877 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:32.493307 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:32.502270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-890c8eb6-ee75-4824-9a04-db493b4dd21b tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1547 microversion: 2.1 time: 0.218803 Apr 08 12:26:32.503159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 512/1065] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:32 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1547 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:32.520264 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:32.524081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:32.524081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:32.525354 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:32.526289 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Searching by: {'deleted': False, 'project_id': '3c8d280858a84a1fa6535c7bdf155095'} {{(pid=98473) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 08 12:26:32.532873 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:32.533466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:32.534575 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:32.535154 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:32.633672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.multi_cell_list [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98473) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 08 12:26:32.729300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-55e25a58-ee83-47e9-beac-643b2e87ebfc tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212937 Apr 08 12:26:32.729945 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 554/1066] 10.222.0.43 () {58 vars in 1115 bytes} [Thu Apr 8 12:26:32 2021] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:32.741628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:32.742294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:32.750199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:32.750742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:32.751583 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:32.752075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:32.958672 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:32.968546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fdc9f71a-a9d2-455d-8603-9583f1ea9118 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1547 microversion: 2.1 time: 0.231421 Apr 08 12:26:32.969551 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 513/1067] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:32 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1547 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:26:32.993534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-d5990ea7-ce13-48ad-b0d1-14a1db134416 req-d44ec8e2-07c1-4817-8554-368c9b922fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d764c2-4fed-4f43-a1f2-822807c71de8", "tag": "fa87f37f-3b47-4e81-b0b3-efa22949c247"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:32.995203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:32.995203 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:33.012852 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d5990ea7-ce13-48ad-b0d1-14a1db134416 req-d44ec8e2-07c1-4817-8554-368c9b922fc6 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:33.013486 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-d5990ea7-ce13-48ad-b0d1-14a1db134416 req-d44ec8e2-07c1-4817-8554-368c9b922fc6 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:33.031553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-d5990ea7-ce13-48ad-b0d1-14a1db134416 req-d44ec8e2-07c1-4817-8554-368c9b922fc6 service nova] Creating event network-changed:fa87f37f-3b47-4e81-b0b3-efa22949c247 for instance 40d764c2-4fed-4f43-a1f2-822807c71de8 on hv-cinder-78477 Apr 08 12:26:33.037540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-d5990ea7-ce13-48ad-b0d1-14a1db134416 req-d44ec8e2-07c1-4817-8554-368c9b922fc6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047886 Apr 08 12:26:33.038429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 555/1068] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:26:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:34.952618 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59174838-ee95-4ce0-8946-624dcfb2f596 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ffb4261-fbf7-481a-b63b-690bdf5ee3c0"}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:34.953819 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59174838-ee95-4ce0-8946-624dcfb2f596 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:34.961841 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59174838-ee95-4ce0-8946-624dcfb2f596 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:34.962406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59174838-ee95-4ce0-8946-624dcfb2f596 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:34.966006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59174838-ee95-4ce0-8946-624dcfb2f596 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:34.966006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59174838-ee95-4ce0-8946-624dcfb2f596 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:35.610771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59174838-ee95-4ce0-8946-624dcfb2f596 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661930 Apr 08 12:26:35.611373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 514/1069] 10.222.0.43 () {60 vars in 1313 bytes} [Thu Apr 8 12:26:34 2021] POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:43.650365 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:43.651146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:43.659284 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:43.659802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:43.660629 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:43.661123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:43.860199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:43.870070 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b8953755-71bf-42ec-844b-0b9e6dcb12b6 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1593 microversion: 2.1 time: 0.225153 Apr 08 12:26:43.870737 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 556/1070] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:43 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1593 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:26:47.131017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-80a76c65-2fc3-4e43-af4f-6bf07259fa08 req-5388dd78-cc2f-4671-b148-6e52dd01aee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d045c-39b8-4f31-ac53-670d393586ec", "tag": "e1cac246-8b1b-4654-8126-5f3b625326b3"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:47.132909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:47.132909 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:47.143002 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-80a76c65-2fc3-4e43-af4f-6bf07259fa08 req-5388dd78-cc2f-4671-b148-6e52dd01aee4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:47.143517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-80a76c65-2fc3-4e43-af4f-6bf07259fa08 req-5388dd78-cc2f-4671-b148-6e52dd01aee4 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:47.161183 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-80a76c65-2fc3-4e43-af4f-6bf07259fa08 req-5388dd78-cc2f-4671-b148-6e52dd01aee4 service nova] Creating event network-changed:e1cac246-8b1b-4654-8126-5f3b625326b3 for instance 9c5d045c-39b8-4f31-ac53-670d393586ec on hv-cinder-78477 Apr 08 12:26:47.171992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-80a76c65-2fc3-4e43-af4f-6bf07259fa08 req-5388dd78-cc2f-4671-b148-6e52dd01aee4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041843 Apr 08 12:26:47.171992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 515/1071] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:49.441349 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1283971879"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:49.441938 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:49.450188 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:49.450731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:49.451560 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:49.452056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:49.684086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.network.security_group_api [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Adding security group 3ae136d2-c985-4a37-bddf-12b98cc5a115 to port e1cac246-8b1b-4654-8126-5f3b625326b3 Apr 08 12:26:50.410557 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-06af8bd8-12b0-4d1f-8fb5-3298ca46173f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/action" status: 202 len: 0 microversion: 2.1 time: 0.973178 Apr 08 12:26:50.411300 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 557/1072] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:26:49 2021] POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/action => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:26:50.421708 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:26:50.422771 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:26:50.425487 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-4d9adcc9-2136-4f29-9a1a-35d4b29b3b7e req-06c40e61-ae3e-420e-bad5-79c7ee298645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d045c-39b8-4f31-ac53-670d393586ec", "tag": "e1cac246-8b1b-4654-8126-5f3b625326b3"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:26:50.427499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:26:50.427499 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:26:50.471543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-4d9adcc9-2136-4f29-9a1a-35d4b29b3b7e req-06c40e61-ae3e-420e-bad5-79c7ee298645 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:50.471543 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-4d9adcc9-2136-4f29-9a1a-35d4b29b3b7e req-06c40e61-ae3e-420e-bad5-79c7ee298645 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:50.472122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:50.472122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:50.472122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:26:50.472122 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:26:50.472509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-4d9adcc9-2136-4f29-9a1a-35d4b29b3b7e req-06c40e61-ae3e-420e-bad5-79c7ee298645 service nova] Creating event network-changed:e1cac246-8b1b-4654-8126-5f3b625326b3 for instance 9c5d045c-39b8-4f31-ac53-670d393586ec on hv-cinder-78477 Apr 08 12:26:50.472509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-4d9adcc9-2136-4f29-9a1a-35d4b29b3b7e req-06c40e61-ae3e-420e-bad5-79c7ee298645 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045790 Apr 08 12:26:50.472509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 558/1073] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:26:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:26:50.670595 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:26:50.681079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ed303a4f-290c-4371-b225-948b8c4f4060 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1759 microversion: 2.1 time: 0.264289 Apr 08 12:26:50.681811 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 516/1074] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:26:50 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1759 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:05.683330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9d7f8c67-5063-44ac-80d3-3f93ddb2acba tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:27:05.684428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9d7f8c67-5063-44ac-80d3-3f93ddb2acba tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:05.693457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d7f8c67-5063-44ac-80d3-3f93ddb2acba tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:05.693974 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d7f8c67-5063-44ac-80d3-3f93ddb2acba tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:05.694850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d7f8c67-5063-44ac-80d3-3f93ddb2acba tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:05.695353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9d7f8c67-5063-44ac-80d3-3f93ddb2acba tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:05.918035 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9d7f8c67-5063-44ac-80d3-3f93ddb2acba tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/action" status: 202 len: 0 microversion: 2.1 time: 0.239630 Apr 08 12:27:05.918754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 559/1075] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:27:05 2021] POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:27:05.927967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:05.928640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:05.938058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:05.938540 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:05.939379 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:05.939874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:06.143448 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:06.153235 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ccf004fc-f614-4fb9-b54b-9b5a8243fecf tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1751 microversion: 2.1 time: 0.229245 Apr 08 12:27:06.153874 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 517/1076] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:05 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:27:07.173829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:07.174641 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:07.182806 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:07.183350 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:07.184199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:07.184702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:07.381611 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:07.391234 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-aa49eaf2-3266-410c-8434-845dba727e2e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.222653 Apr 08 12:27:07.391879 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 560/1077] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:07 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:08.410191 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:08.410889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:08.418921 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:08.419459 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:08.420993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:08.421491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:08.621251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:08.631789 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6f5d679c-d6be-47fe-9ca3-024b6a5bcc0c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.225731 Apr 08 12:27:08.632414 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 518/1078] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:08 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:09.649960 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:09.650654 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:09.659376 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:09.659884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:09.660733 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:09.661224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:09.858671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:09.868023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-cac60088-6dbd-4e65-8c84-8d2c9de2cf74 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.222079 Apr 08 12:27:09.868655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 561/1079] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:09 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:10.887268 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:10.887951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:10.896432 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:10.896957 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:10.897807 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:10.898339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:11.095502 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:11.105105 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ae197d7b-5843-4fd5-89ae-c6b12a52bf03 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.221968 Apr 08 12:27:11.105738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 519/1080] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:10 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:12.123467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:12.124157 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:12.133011 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:12.133519 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:12.134363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:12.134884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:12.331964 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:12.341453 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-fac238b7-fb14-41da-b2f2-9a0b63fa6990 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.222018 Apr 08 12:27:12.342065 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 562/1081] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:12 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:13.360738 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:13.361431 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:13.369330 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:13.369842 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:13.370715 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:13.371216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:13.573372 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:13.582956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-293712be-fe54-41d8-8ffc-a6f8e2f9e021 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.226397 Apr 08 12:27:13.583577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 520/1082] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:13 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:14.601959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:14.602597 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:14.610675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:14.611815 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:14.612652 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:14.613141 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:14.809981 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:14.819633 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-29b218b1-248a-48f9-9ec9-c1b69ab13094 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.221776 Apr 08 12:27:14.820255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 563/1083] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:14 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:15.838072 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:15.838785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:15.847058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:15.847586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:15.848434 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:15.848941 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:16.044492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:16.054707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ed5fca3a-a36b-490f-a458-5f8092df8ca8 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.220565 Apr 08 12:27:16.055328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 521/1084] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:15 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:17.074635 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:17.075353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:17.084033 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:17.084550 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:17.085435 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:17.085931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:17.280345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:17.289757 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3f3a929b-f045-4969-b7a3-c148ce635a9d tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1756 microversion: 2.1 time: 0.219337 Apr 08 12:27:17.290411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 564/1085] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:17 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:18.308832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:18.309504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:18.318614 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:18.319129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:18.319973 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:18.320466 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:18.519480 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:18.528862 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-541d2fbc-271d-4c34-9c56-ef1a49b8fd5e tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1759 microversion: 2.1 time: 0.224170 Apr 08 12:27:18.529478 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 522/1086] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:18 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1759 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:41.146944 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:27:41.147518 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:27:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:27:51.438331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1283971879"}} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:27:51.438928 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:51.446936 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:51.447511 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:51.449254 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:51.449758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:51.867676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.network.security_group_api [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Removing security group 3ae136d2-c985-4a37-bddf-12b98cc5a115 from port e1cac246-8b1b-4654-8126-5f3b625326b3 Apr 08 12:27:52.611079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8980d968-09f7-4e66-9e25-9d08e66baed0 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/action" status: 202 len: 0 microversion: 2.1 time: 1.176998 Apr 08 12:27:52.611982 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 565/1087] 10.222.0.43 () {60 vars in 1268 bytes} [Thu Apr 8 12:27:51 2021] POST /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/action => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:27:52.619911 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-383ef23d-8796-46b8-9aea-6c8c36590ee7 req-88333594-2c4e-4c07-b23f-8d39857f9b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d045c-39b8-4f31-ac53-670d393586ec", "tag": "e1cac246-8b1b-4654-8126-5f3b625326b3"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:27:52.622160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:27:52.622160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:27:52.633702 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-383ef23d-8796-46b8-9aea-6c8c36590ee7 req-88333594-2c4e-4c07-b23f-8d39857f9b50 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:52.634509 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-383ef23d-8796-46b8-9aea-6c8c36590ee7 req-88333594-2c4e-4c07-b23f-8d39857f9b50 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:52.655304 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-383ef23d-8796-46b8-9aea-6c8c36590ee7 req-88333594-2c4e-4c07-b23f-8d39857f9b50 service nova] Creating event network-changed:e1cac246-8b1b-4654-8126-5f3b625326b3 for instance 9c5d045c-39b8-4f31-ac53-670d393586ec on hv-cinder-78477 Apr 08 12:27:52.660989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-383ef23d-8796-46b8-9aea-6c8c36590ee7 req-88333594-2c4e-4c07-b23f-8d39857f9b50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045144 Apr 08 12:27:52.661853 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 523/1088] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:27:54.892206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-8f6528a1-f0af-4573-ab12-a3845500e7ed req-792b52a7-f702-4065-a849-b7d6db09df09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d045c-39b8-4f31-ac53-670d393586ec", "tag": "e1cac246-8b1b-4654-8126-5f3b625326b3"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:27:54.893856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:27:54.893856 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:27:54.900089 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:54.900671 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:54.908707 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:54.909216 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:54.909785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-8f6528a1-f0af-4573-ab12-a3845500e7ed req-792b52a7-f702-4065-a849-b7d6db09df09 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:54.910058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:54.910294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-8f6528a1-f0af-4573-ab12-a3845500e7ed req-792b52a7-f702-4065-a849-b7d6db09df09 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:54.910574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:54.929531 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-8f6528a1-f0af-4573-ab12-a3845500e7ed req-792b52a7-f702-4065-a849-b7d6db09df09 service nova] Creating event network-changed:e1cac246-8b1b-4654-8126-5f3b625326b3 for instance 9c5d045c-39b8-4f31-ac53-670d393586ec on hv-cinder-78477 Apr 08 12:27:54.936116 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-8f6528a1-f0af-4573-ab12-a3845500e7ed req-792b52a7-f702-4065-a849-b7d6db09df09 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048373 Apr 08 12:27:54.937098 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 524/1089] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:27:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:27:55.089987 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.objects.instance [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lazy-loading 'services' on Instance uuid 9c5d045c-39b8-4f31-ac53-670d393586ec {{(pid=98473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 08 12:27:55.325080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-1e13e1fb-e7af-4ee7-a3d3-fc3c82a99294 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments/5ffb4261-fbf7-481a-b63b-690bdf5ee3c0" status: 202 len: 0 microversion: 2.1 time: 0.440073 Apr 08 12:27:55.325920 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 566/1090] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:27:54 2021] DELETE /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments/5ffb4261-fbf7-481a-b63b-690bdf5ee3c0 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:27:55.335085 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-f8e4a574-6e9b-4aeb-9c72-680c65c5608c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:55.336601 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-f8e4a574-6e9b-4aeb-9c72-680c65c5608c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:55.346483 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8e4a574-6e9b-4aeb-9c72-680c65c5608c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:55.352574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8e4a574-6e9b-4aeb-9c72-680c65c5608c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:55.352574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8e4a574-6e9b-4aeb-9c72-680c65c5608c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:55.352574 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-f8e4a574-6e9b-4aeb-9c72-680c65c5608c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:55.424146 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-f8e4a574-6e9b-4aeb-9c72-680c65c5608c tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093420 Apr 08 12:27:55.425079 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 525/1091] 10.222.0.43 () {58 vars in 1292 bytes} [Thu Apr 8 12:27:55 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:27:56.438182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a7857329-6eb7-4da0-b716-bc3347bd2918 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:56.439435 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a7857329-6eb7-4da0-b716-bc3347bd2918 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:56.448405 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7857329-6eb7-4da0-b716-bc3347bd2918 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:56.448933 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7857329-6eb7-4da0-b716-bc3347bd2918 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:56.449772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7857329-6eb7-4da0-b716-bc3347bd2918 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:56.450265 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a7857329-6eb7-4da0-b716-bc3347bd2918 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:56.520153 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a7857329-6eb7-4da0-b716-bc3347bd2918 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086503 Apr 08 12:27:56.520662 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 567/1092] 10.222.0.43 () {58 vars in 1292 bytes} [Thu Apr 8 12:27:56 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 12:27:56.532461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:56.533017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:56.540899 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:56.542130 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:56.543023 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:56.543527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:56.709299 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] HTTP exception thrown: Instance 9c5d045c-39b8-4f31-ac53-670d393586ec is not attached to volume 5ffb4261-fbf7-481a-b63b-690bdf5ee3c0 Apr 08 12:27:56.709977 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Returning 404 to user: Instance 9c5d045c-39b8-4f31-ac53-670d393586ec is not attached to volume 5ffb4261-fbf7-481a-b63b-690bdf5ee3c0 {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:27:56.710926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-eba16430-a534-4322-a0e4-15f5b91dad53 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments/5ffb4261-fbf7-481a-b63b-690bdf5ee3c0" status: 404 len: 154 microversion: 2.1 time: 0.182812 Apr 08 12:27:56.711534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 526/1093] 10.222.0.43 () {58 vars in 1406 bytes} [Thu Apr 8 12:27:56 2021] DELETE /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec/os-volume_attachments/5ffb4261-fbf7-481a-b63b-690bdf5ee3c0 => generated 154 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:27:58.143966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:58.144553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:58.152280 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:58.152799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:58.153956 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:58.154474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:58.221408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:27:58.428287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9ebaf6c1-09d7-4464-9b93-508047690bfb tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 204 len: 0 microversion: 2.1 time: 0.287873 Apr 08 12:27:58.428933 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 568/1094] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:27:58 2021] DELETE /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:27:58.437682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:58.441517 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:58.446338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:58.446884 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:58.447731 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:58.448276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:58.733836 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:58.742808 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-35a01a1b-eb95-484e-b78f-f674a2ab5cef tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1553 microversion: 2.1 time: 0.309172 Apr 08 12:27:58.743438 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 527/1095] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:58 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:27:59.762424 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:27:59.763145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:27:59.771328 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:59.771850 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:59.772855 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:27:59.773363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:27:59.966352 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:27:59.976047 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-88e592dc-5253-46c2-b0dd-205e412f6e28 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1553 microversion: 2.1 time: 0.218284 Apr 08 12:27:59.976680 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 569/1096] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:27:59 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:00.993375 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:00.994145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:01.003044 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:01.003559 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:01.004657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:01.005189 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:01.129018 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-255a159c-ede0-4429-b081-541826b39334 req-33552321-ff5e-436a-8954-7c7031445b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5d045c-39b8-4f31-ac53-670d393586ec", "name": "network-vif-deleted", "tag": "e1cac246-8b1b-4654-8126-5f3b625326b3"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:28:01.131187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:28:01.131187 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:28:01.137546 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fc126aa68f496098e6013c4d804489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d280858a84a1fa6535c7bdf155095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:01.141236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-255a159c-ede0-4429-b081-541826b39334 req-33552321-ff5e-436a-8954-7c7031445b3d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:01.141751 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-255a159c-ede0-4429-b081-541826b39334 req-33552321-ff5e-436a-8954-7c7031445b3d service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:01.147377 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e465ad2e-70a7-4ba7-8796-cf6785da0fd1 tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 200 len: 1511 microversion: 2.1 time: 0.158056 Apr 08 12:28:01.148007 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 528/1097] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:00 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:01.159967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-255a159c-ede0-4429-b081-541826b39334 req-33552321-ff5e-436a-8954-7c7031445b3d service nova] Creating event network-vif-deleted:e1cac246-8b1b-4654-8126-5f3b625326b3 for instance 9c5d045c-39b8-4f31-ac53-670d393586ec on hv-cinder-78477 Apr 08 12:28:01.165381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-255a159c-ede0-4429-b081-541826b39334 req-33552321-ff5e-436a-8954-7c7031445b3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040517 Apr 08 12:28:01.166080 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 570/1098] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:28:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:28:02.166594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:02.167430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] [instance: 9c5d045c-39b8-4f31-ac53-670d393586ec] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:02.175168 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:02.175682 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:02.176657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:02.177159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:02.229934 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] HTTP exception thrown: Instance 9c5d045c-39b8-4f31-ac53-670d393586ec could not be found. Apr 08 12:28:02.230625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Returning 404 to user: Instance 9c5d045c-39b8-4f31-ac53-670d393586ec could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:28:02.231524 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-27b163ad-3a4f-4268-8199-3b8eb8905e5f tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec" status: 404 len: 111 microversion: 2.1 time: 0.069227 Apr 08 12:28:02.232640 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 529/1099] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:02 2021] GET /compute/v2.1/servers/9c5d045c-39b8-4f31-ac53-670d393586ec => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:28:02.242139 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8bb882ca-9ff1-461f-9835-58e7e3d487db tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] Calling method '.version_select at 0x7f225880e510>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:02.308892 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8bb882ca-9ff1-461f-9835-58e7e3d487db tempest-TestMinimumBasicScenario-1471672942 tempest-TestMinimumBasicScenario-1471672942-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-533517611" status: 202 len: 0 microversion: 2.1 time: 0.071223 Apr 08 12:28:02.309503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 571/1100] 10.222.0.43 () {58 vars in 1259 bytes} [Thu Apr 8 12:28:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-533517611 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:28:09.173669 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:28:09.174147 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:28:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:28:10.750627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-271462611", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1775416410", "security_groups": [{"name": "tempest-secgroup-smoke-332410541"}], "block_device_mapping_v2": [{"uuid": "74e50d44-97a1-457d-a2de-eb4ca69ab08e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f160ec1-7ce7-4365-ac22-b0d5421f97ed"}]}} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:28:10.903547 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.network.neutron [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] validate_networks() for [('7f160ec1-7ce7-4365-ac22-b0d5421f97ed', None, None, None)] {{(pid=98474) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 08 12:28:11.540749 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Flavor limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:28:11.541412 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Image limits 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 08 12:28:11.541962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Flavor pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:28:11.542474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Image pref 0:0:0 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 08 12:28:11.542988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.virt.hardware [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 08 12:28:11.552866 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:11.553371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:11.554243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:11.554766 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:11.574273 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for project 5174f889b4cf4def811b78439275f602. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 08 12:28:11.579052 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.quota [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Getting quotas for user 50b370fd6c2b4462a4199830f771ea1c and project 5174f889b4cf4def811b78439275f602. Resources: {'instances', 'cores', 'ram'} {{(pid=98474) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 08 12:28:11.691196 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Going to run 1 instances... {{(pid=98474) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 08 12:28:11.693586 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74e50d44-97a1-457d-a2de-eb4ca69ab08e',volume_size=None,volume_type=None)] {{(pid=98474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 08 12:28:12.003250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d5e9348f-b313-4ffe-b0ca-8b459f3cc454 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.256728 Apr 08 12:28:12.009772 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 530/1101] 10.222.0.43 () {60 vars in 1137 bytes} [Thu Apr 8 12:28:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 12:28:12.016577 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-8b4b7d7b-c17b-4960-b3a5-ab505d1c475f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:12.017388 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-8b4b7d7b-c17b-4960-b3a5-ab505d1c475f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:12.147200 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-8b4b7d7b-c17b-4960-b3a5-ab505d1c475f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:12.158660 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-8b4b7d7b-c17b-4960-b3a5-ab505d1c475f tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1094 microversion: 2.1 time: 0.147332 Apr 08 12:28:12.159275 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 572/1102] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:12 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1094 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:13.178706 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:13.179534 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:13.190834 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:13.191674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:13.192567 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:13.193151 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:13.326594 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:13.335461 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-54b559ab-ff72-44ea-b775-acba0e38629d tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1192 microversion: 2.1 time: 0.162677 Apr 08 12:28:13.336084 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 531/1103] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:13 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1192 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:14.354492 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:14.355159 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:14.366337 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:14.367272 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:14.368298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:14.368785 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:14.676129 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:14.685775 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d96c6631-1fc6-4410-8344-ed1782387842 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1210 microversion: 2.1 time: 0.335435 Apr 08 12:28:14.686426 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 573/1104] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:14 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1210 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:15.704678 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:15.706024 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:15.714536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:15.715310 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:15.716475 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:15.717184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:15.991983 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:16.002066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-17ff6f32-a66c-442b-aa08-069796b191e6 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.301862 Apr 08 12:28:16.004889 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 532/1105] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:15 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:17.021177 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:17.028004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:17.028004 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3fba3ed-ffac-4b1b-8aaf-8944c3da1ee5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 12:28:17.033006 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:17.033653 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:17.034675 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:17.035340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:17.692533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:17.698279 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0ecc30cb-c28f-4a0e-868d-7acaeb427174 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.681365 Apr 08 12:28:17.698942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 574/1106] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:17 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:18.043851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-2885fff4-b6d6-44b2-beac-a9db2bed7d03 req-a25f3004-c2e1-4789-a0d9-286aaaca901e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c2a30e-09b2-4146-863d-7993bc44b55a", "tag": "392861b4-9ae6-4b25-a046-7df1b14e8813"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:28:18.045696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:28:18.045696 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:28:18.057685 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-2885fff4-b6d6-44b2-beac-a9db2bed7d03 req-a25f3004-c2e1-4789-a0d9-286aaaca901e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:18.058295 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-2885fff4-b6d6-44b2-beac-a9db2bed7d03 req-a25f3004-c2e1-4789-a0d9-286aaaca901e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:18.236581 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-2885fff4-b6d6-44b2-beac-a9db2bed7d03 req-a25f3004-c2e1-4789-a0d9-286aaaca901e service nova] Creating event network-changed:392861b4-9ae6-4b25-a046-7df1b14e8813 for instance f2c2a30e-09b2-4146-863d-7993bc44b55a on hv-cinder-78477 Apr 08 12:28:18.242182 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-2885fff4-b6d6-44b2-beac-a9db2bed7d03 req-a25f3004-c2e1-4789-a0d9-286aaaca901e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202281 Apr 08 12:28:18.243226 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 533/1107] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:28:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:28:18.716823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:18.717500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:18.741357 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3fba3ed-ffac-4b1b-8aaf-8944c3da1ee5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54932. Apr 08 12:28:18.745616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:18.746131 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:18.747709 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:18.748345 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:19.056914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:19.074104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-41007097-b2e5-415e-9bc9-8393a40ff338 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.361534 Apr 08 12:28:19.086428 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 575/1108] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:18 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:20.094121 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:20.094947 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:20.103029 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:20.103863 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:20.104716 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:20.105211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:20.661274 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:20.670467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-e79192d4-c515-4cee-8e60-cd7a0d163702 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.582027 Apr 08 12:28:20.671163 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 534/1109] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:20 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:21.689036 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:21.689607 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:21.697396 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:21.697901 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:21.698792 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:21.699285 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:21.904086 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:21.911193 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2711d94b-5ae9-41ea-a9a8-0f8ed2a53ee1 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.226778 Apr 08 12:28:21.911816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 576/1110] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:21 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:22.930145 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:22.930774 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:22.939993 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:22.940515 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:22.941383 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:22.941886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:23.140712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:23.149565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4a071063-050b-493a-8938-d6c03078ab98 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.223800 Apr 08 12:28:23.150172 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 535/1111] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:22 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:24.167713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:24.168406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:24.176474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:24.176992 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:24.177831 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:24.178371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:24.369451 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:24.380046 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-321faa02-b64a-434d-bd29-29ac9b6ad743 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.215134 Apr 08 12:28:24.380712 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 577/1112] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:24 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:28:25.398787 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:25.399410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:25.408403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:25.408914 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:25.409754 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:25.410454 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:25.608532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:25.617374 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-d8cc71c8-f503-4e05-9cc5-fd9fc9afbf9b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.222633 Apr 08 12:28:25.617989 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 536/1113] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:25 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:28:26.640066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:26.640066 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:26.644590 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:26.645104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:26.645952 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:26.646474 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:26.841469 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:26.850456 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-c5c0f10b-f05b-49c0-b686-d3fefba39b19 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.218857 Apr 08 12:28:26.851077 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 578/1114] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:26 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:27.868760 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:27.869440 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:27.878074 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:27.878674 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:27.879525 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:27.880294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:27.980732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-ba7e010c-aabd-4057-b955-6505dfca4532 req-95b6beee-2ed8-4549-9930-bc910d3e459e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c2a30e-09b2-4146-863d-7993bc44b55a", "name": "network-vif-plugged", "status": "completed", "tag": "392861b4-9ae6-4b25-a046-7df1b14e8813"}]} {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:28:27.983276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:28:27.983276 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:28:27.992381 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ba7e010c-aabd-4057-b955-6505dfca4532 req-95b6beee-2ed8-4549-9930-bc910d3e459e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:27.994758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ba7e010c-aabd-4057-b955-6505dfca4532 req-95b6beee-2ed8-4549-9930-bc910d3e459e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:28.011251 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-ba7e010c-aabd-4057-b955-6505dfca4532 req-95b6beee-2ed8-4549-9930-bc910d3e459e service nova] Creating event network-vif-plugged:392861b4-9ae6-4b25-a046-7df1b14e8813 for instance f2c2a30e-09b2-4146-863d-7993bc44b55a on hv-cinder-78477 Apr 08 12:28:28.016719 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-ba7e010c-aabd-4057-b955-6505dfca4532 req-95b6beee-2ed8-4549-9930-bc910d3e459e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039741 Apr 08 12:28:28.017493 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 579/1115] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:28:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:28:28.078270 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:28.087527 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-2945190c-5b1f-4418-b884-fea59d91a58a tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.222900 Apr 08 12:28:28.088256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 537/1116] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:27 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:29.106465 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:29.107413 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:29.115788 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:29.116294 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:29.117138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:29.118969 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:29.321406 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:29.330408 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-75f397fc-94ae-450d-ba67-61337defaf3b tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1265 microversion: 2.1 time: 0.228905 Apr 08 12:28:29.331028 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 580/1117] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:29 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:30.348463 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:30.349142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:30.357338 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:30.357862 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:30.358732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:30.359236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:30.555648 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:30.565263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-9fa5e681-bb57-4c3a-9f27-b3fd429236fa tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1451 microversion: 2.1 time: 0.220905 Apr 08 12:28:30.565882 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 538/1118] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:30 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1451 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:30.583041 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:28:30.583758 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:28:30.591776 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:30.592287 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:30.593192 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:30.593686 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:30.785331 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:28:30.795000 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-682ad052-66e6-4a5e-9dbd-c6829f44e81e tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1451 microversion: 2.1 time: 0.215953 Apr 08 12:28:30.795627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 581/1119] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:28:30 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:28:33.889104 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-6dc3cc97-63a9-436e-bf85-99ea1d3bdbc1 req-5f7435fa-ab2c-42f4-a52d-02dbaf5049f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c2a30e-09b2-4146-863d-7993bc44b55a", "tag": "392861b4-9ae6-4b25-a046-7df1b14e8813"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:28:33.891627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:28:33.891627 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:28:33.902166 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-6dc3cc97-63a9-436e-bf85-99ea1d3bdbc1 req-5f7435fa-ab2c-42f4-a52d-02dbaf5049f5 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:28:33.902756 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-6dc3cc97-63a9-436e-bf85-99ea1d3bdbc1 req-5f7435fa-ab2c-42f4-a52d-02dbaf5049f5 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:28:33.920565 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-6dc3cc97-63a9-436e-bf85-99ea1d3bdbc1 req-5f7435fa-ab2c-42f4-a52d-02dbaf5049f5 service nova] Creating event network-changed:392861b4-9ae6-4b25-a046-7df1b14e8813 for instance f2c2a30e-09b2-4146-863d-7993bc44b55a on hv-cinder-78477 Apr 08 12:28:33.925903 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-6dc3cc97-63a9-436e-bf85-99ea1d3bdbc1 req-5f7435fa-ab2c-42f4-a52d-02dbaf5049f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042930 Apr 08 12:28:33.926599 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 539/1120] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:28:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:29:57.031829 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:29:57.032628 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:29:57.035835 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-a4e04689-073a-4fb4-a17f-5baed557216d req-5f9da3a9-077f-4cc8-ab14-d9a75051c43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c2a30e-09b2-4146-863d-7993bc44b55a", "tag": "392861b4-9ae6-4b25-a046-7df1b14e8813"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:29:57.037532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:29:57.037532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:29:57.041343 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:29:57.042073 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:29:57.043457 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:29:57.044038 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:29:57.049851 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a4e04689-073a-4fb4-a17f-5baed557216d req-5f9da3a9-077f-4cc8-ab14-d9a75051c43e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:29:57.050481 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-a4e04689-073a-4fb4-a17f-5baed557216d req-5f9da3a9-077f-4cc8-ab14-d9a75051c43e service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:29:57.072533 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-a4e04689-073a-4fb4-a17f-5baed557216d req-5f9da3a9-077f-4cc8-ab14-d9a75051c43e service nova] Creating event network-changed:392861b4-9ae6-4b25-a046-7df1b14e8813 for instance f2c2a30e-09b2-4146-863d-7993bc44b55a on hv-cinder-78477 Apr 08 12:29:57.080750 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-a4e04689-073a-4fb4-a17f-5baed557216d req-5f9da3a9-077f-4cc8-ab14-d9a75051c43e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048810 Apr 08 12:29:57.081241 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 540/1121] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:29:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:29:57.120508 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:29:57.340962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-59af3570-7882-472e-89e3-8c426c9e6115 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 204 len: 0 microversion: 2.1 time: 0.314030 Apr 08 12:29:57.341805 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 582/1122] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:29:57 2021] DELETE /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:29:57.351339 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:29:57.352125 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:29:57.360604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:29:57.361233 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:29:57.362087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:29:57.362612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:29:57.898201 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:29:57.908278 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-0dfd2ae2-3d77-4cfd-9b2b-02c9b9bcb9c3 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1576 microversion: 2.1 time: 0.561400 Apr 08 12:29:57.908931 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 541/1123] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:29:57 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1576 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:29:58.928418 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:29:58.929248 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:29:58.937812 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:29:58.938340 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:29:58.939250 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:29:58.939755 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:29:59.367988 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:29:59.377612 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-a19e7320-cdbe-4a42-83c9-a9a10b641238 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1457 microversion: 2.1 time: 0.453712 Apr 08 12:29:59.378249 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 583/1124] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:29:58 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1457 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:30:00.157727 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-9c521397-2ebb-4e2d-bf0b-6b104b6fba60 req-1d9edc2f-7070-4841-8d1f-e13e8335b7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c2a30e-09b2-4146-863d-7993bc44b55a", "name": "network-vif-deleted", "tag": "392861b4-9ae6-4b25-a046-7df1b14e8813"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:30:00.159429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:30:00.159429 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:30:00.168826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9c521397-2ebb-4e2d-bf0b-6b104b6fba60 req-1d9edc2f-7070-4841-8d1f-e13e8335b7bc service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:00.169336 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-9c521397-2ebb-4e2d-bf0b-6b104b6fba60 req-1d9edc2f-7070-4841-8d1f-e13e8335b7bc service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:00.187588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-9c521397-2ebb-4e2d-bf0b-6b104b6fba60 req-1d9edc2f-7070-4841-8d1f-e13e8335b7bc service nova] Creating event network-vif-deleted:392861b4-9ae6-4b25-a046-7df1b14e8813 for instance f2c2a30e-09b2-4146-863d-7993bc44b55a on hv-cinder-78477 Apr 08 12:30:00.195553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-9c521397-2ebb-4e2d-bf0b-6b104b6fba60 req-1d9edc2f-7070-4841-8d1f-e13e8335b7bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097272 Apr 08 12:30:00.195553 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 542/1125] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:30:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:30:00.396411 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:00.397503 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:00.406676 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:00.407400 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:00.408625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:00.409447 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:00.621687 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:30:00.630922 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3ae26293-44a2-4908-a0ff-55a7ee5fff81 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 200 len: 1225 microversion: 2.1 time: 0.238345 Apr 08 12:30:00.631507 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 584/1126] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:30:00 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 1225 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:30:01.650410 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:01.651802 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: f2c2a30e-09b2-4146-863d-7993bc44b55a] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:01.660212 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:01.660742 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:01.661588 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:01.662140 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:01.714713 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] HTTP exception thrown: Instance f2c2a30e-09b2-4146-863d-7993bc44b55a could not be found. Apr 08 12:30:01.715320 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Returning 404 to user: Instance f2c2a30e-09b2-4146-863d-7993bc44b55a could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:30:01.716224 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-b32c93c1-354c-47f3-a581-e23713440aa0 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a" status: 404 len: 111 microversion: 2.1 time: 0.070405 Apr 08 12:30:01.716826 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 543/1127] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:30:01 2021] GET /compute/v2.1/servers/f2c2a30e-09b2-4146-863d-7993bc44b55a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:30:05.882034 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:05.882625 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:05.891230 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:05.891967 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:05.892823 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:05.893371 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:05.937266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-74520520-bf49-4b8a-b1e9-3c8c665028b9 req-a9c53b5c-9284-41ce-afb9-636822b91313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d764c2-4fed-4f43-a1f2-822807c71de8", "tag": "fa87f37f-3b47-4e81-b0b3-efa22949c247"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:30:05.939087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:30:05.939087 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:30:05.948081 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-74520520-bf49-4b8a-b1e9-3c8c665028b9 req-a9c53b5c-9284-41ce-afb9-636822b91313 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:05.948636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-74520520-bf49-4b8a-b1e9-3c8c665028b9 req-a9c53b5c-9284-41ce-afb9-636822b91313 service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:05.966570 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-74520520-bf49-4b8a-b1e9-3c8c665028b9 req-a9c53b5c-9284-41ce-afb9-636822b91313 service nova] Creating event network-changed:fa87f37f-3b47-4e81-b0b3-efa22949c247 for instance 40d764c2-4fed-4f43-a1f2-822807c71de8 on hv-cinder-78477 Apr 08 12:30:05.968184 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Going to try to terminate instance {{(pid=98473) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 08 12:30:05.972058 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-74520520-bf49-4b8a-b1e9-3c8c665028b9 req-a9c53b5c-9284-41ce-afb9-636822b91313 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097806 Apr 08 12:30:05.972951 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 544/1128] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:30:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:30:06.367075 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-4a963e49-da62-4cd5-8558-179b2384c684 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 204 len: 0 microversion: 2.1 time: 0.495329 Apr 08 12:30:06.367832 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 585/1129] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:30:05 2021] DELETE /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 12:30:06.377441 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:06.378186 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:06.387468 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:06.388263 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:06.389403 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:06.390266 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:06.657881 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:30:06.669255 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-13ff7723-d4b3-4b3b-a13a-58d262ce2300 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1577 microversion: 2.1 time: 0.296176 Apr 08 12:30:06.670373 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 545/1130] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:30:06 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1577 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:30:07.689360 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:07.690064 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:07.698839 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:07.699363 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:07.700199 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:07.700692 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:08.241368 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:30:08.251138 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-62bbc3a4-3970-4513-a8a7-8c94e2522328 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1458 microversion: 2.1 time: 0.566256 Apr 08 12:30:08.251768 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 586/1131] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:30:07 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1458 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:30:09.095056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [req-ce99dbf8-6098-4526-b9f3-95ed8fddc09a req-c3a1b4ec-4050-4fea-9120-29db889e7fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d764c2-4fed-4f43-a1f2-822807c71de8", "name": "network-vif-deleted", "tag": "fa87f37f-3b47-4e81-b0b3-efa22949c247"}]} {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:30:09.096883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 12:30:09.096883 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: warnings.warn(msg) Apr 08 12:30:09.106430 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ce99dbf8-6098-4526-b9f3-95ed8fddc09a req-c3a1b4ec-4050-4fea-9120-29db889e7fde service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:09.106942 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [req-ce99dbf8-6098-4526-b9f3-95ed8fddc09a req-c3a1b4ec-4050-4fea-9120-29db889e7fde service nova] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:09.125225 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.compute.server_external_events [req-ce99dbf8-6098-4526-b9f3-95ed8fddc09a req-c3a1b4ec-4050-4fea-9120-29db889e7fde service nova] Creating event network-vif-deleted:fa87f37f-3b47-4e81-b0b3-efa22949c247 for instance 40d764c2-4fed-4f43-a1f2-822807c71de8 on hv-cinder-78477 Apr 08 12:30:09.131031 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [req-ce99dbf8-6098-4526-b9f3-95ed8fddc09a req-c3a1b4ec-4050-4fea-9120-29db889e7fde service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039635 Apr 08 12:30:09.131694 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 546/1132] 10.222.0.43 () {64 vars in 1308 bytes} [Thu Apr 8 12:30:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:30:09.269940 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:09.270657 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:09.279126 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:09.279636 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:09.280467 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:09.280959 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:09.455664 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.policy [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b370fd6c2b4462a4199830f771ea1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5174f889b4cf4def811b78439275f602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98473) authorize /opt/stack/nova/nova/policy.py:202}} Apr 08 12:30:09.465604 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-ee798e81-bd95-4cb1-bfc5-8c93bc03ce55 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 200 len: 1226 microversion: 2.1 time: 0.199839 Apr 08 12:30:09.466243 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 587/1133] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:30:09 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 1226 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:30:10.484017 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:10.484801 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 40d764c2-4fed-4f43-a1f2-822807c71de8] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:10.492987 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:10.493513 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:10.494422 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:10.495532 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:10.547536 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] HTTP exception thrown: Instance 40d764c2-4fed-4f43-a1f2-822807c71de8 could not be found. Apr 08 12:30:10.548206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Returning 404 to user: Instance 40d764c2-4fed-4f43-a1f2-822807c71de8 could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:30:10.549102 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-5eeeeb24-6c6a-4250-a0fb-0abe84791a18 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8" status: 404 len: 111 microversion: 2.1 time: 0.070228 Apr 08 12:30:10.549697 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 547/1134] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:30:10 2021] GET /compute/v2.1/servers/40d764c2-4fed-4f43-a1f2-822807c71de8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:30:11.780500 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:11.781056 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98473) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:11.788994 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:11.789504 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:11.790353 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:11.790847 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98473) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:11.844123 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] HTTP exception thrown: Instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e could not be found. Apr 08 12:30:11.844779 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Returning 404 to user: Instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e could not be found. {{(pid=98473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:30:11.845666 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-3adb6abd-5274-453f-b9f0-212870e528a4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 404 len: 111 microversion: 2.1 time: 0.069556 Apr 08 12:30:11.846256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 588/1135] 10.222.0.43 () {58 vars in 1229 bytes} [Thu Apr 8 12:30:11 2021] DELETE /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:30:11.855256 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '>' {{(pid=98474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:11.855926 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.compute.api [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] [instance: 375ccd7f-c302-4444-85aa-7b4ab2af3a6e] Fetching instance by UUID {{(pid=98474) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 08 12:30:11.863634 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:11.864142 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:11.864966 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 08 12:30:11.865455 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG oslo_concurrency.lockutils [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Lock "6939815c-34f4-422f-95c0-797235378b0a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98474) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 08 12:30:11.918646 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.wsgi [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] HTTP exception thrown: Instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e could not be found. Apr 08 12:30:11.919316 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Returning 404 to user: Instance 375ccd7f-c302-4444-85aa-7b4ab2af3a6e could not be found. {{(pid=98474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 08 12:30:11.920211 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-80e75776-ee4c-43b2-811b-7a304f2aa839 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e" status: 404 len: 111 microversion: 2.1 time: 0.069363 Apr 08 12:30:11.920799 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98474|app: 0|req: 548/1136] 10.222.0.43 () {58 vars in 1226 bytes} [Thu Apr 8 12:30:11 2021] GET /compute/v2.1/servers/375ccd7f-c302-4444-85aa-7b4ab2af3a6e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:30:13.485317 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: DEBUG nova.api.openstack.wsgi [None req-6d90e400-b13e-4e9b-af2c-5baf2601b8f4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] Calling method '.version_select at 0x7f225d8f3510>' {{(pid=98473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 08 12:30:13.523616 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO nova.api.openstack.requestlog [None req-6d90e400-b13e-4e9b-af2c-5baf2601b8f4 tempest-TestVolumeBootPattern-1340280433 tempest-TestVolumeBootPattern-1340280433-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1775416410" status: 202 len: 0 microversion: 2.1 time: 0.042331 Apr 08 12:30:13.524206 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: [pid: 98473|app: 0|req: 589/1137] 10.222.0.43 () {58 vars in 1253 bytes} [Thu Apr 8 12:30:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1775416410 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 12:31:01.164592 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:31:01.165160 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:31:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:31:29.190962 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:31:29.191491 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:31:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:33:04.977311 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:33:04.977886 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:33:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:33:07.211101 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:33:07.211644 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:33:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:33:10.393054 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:33:10.393655 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:33:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:34:21.187732 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:34:21.188298 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:34:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:34:49.207236 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:34:49.207816 dv-cinder-784779-3-iscsi devstack@n-api.service[98472]: Thu Apr 8 12:34:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!